[==========] Running 15 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 13 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260807 07:55:32.087409 27906 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.64.190:36165
I20260807 07:55:32.090404 27906 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 07:55:32.092056 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:55:32.113049 27917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:55:32.114672 27923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:55:32.114017 27919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:55:33.310622 27921 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1196 milliseconds
I20260807 07:55:33.310781 27906 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260807 07:55:33.312338 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:55:33.312641 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:55:33.312858 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089333312833 us; error 0 us; skew 500 ppm
I20260807 07:55:33.314137 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:55:33.321154 27906 webserver.cc:533] Webserver started at http://127.27.64.190:35337/ using document root <none> and password file <none>
I20260807 07:55:33.322849 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:55:33.323078 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:55:33.323724 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:55:33.330360 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/master-0-root/instance:
uuid: "c1386f3207d446aea45efc277a5591be"
format_stamp: "Formatted at 2026-08-07 07:55:33 on dist-test-slave-f0tn"
I20260807 07:55:33.341450 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.006s sys 0.003s
I20260807 07:55:33.349007 27934 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:55:33.350809 27906 fs_manager.cc:730] Time spent opening block manager: real 0.006s user 0.004s sys 0.003s
I20260807 07:55:33.351311 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/master-0-root
uuid: "c1386f3207d446aea45efc277a5591be"
format_stamp: "Formatted at 2026-08-07 07:55:33 on dist-test-slave-f0tn"
I20260807 07:55:33.351675 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:55:33.406916 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:55:33.408784 27906 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 07:55:33.409296 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:55:33.490056 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.190:36165
I20260807 07:55:33.490156 28012 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.190:36165 every 8 connection(s)
I20260807 07:55:33.504093 28013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:33.531562 28013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be: Bootstrap starting.
I20260807 07:55:33.539863 28013 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:33.542716 28013 log.cc:826] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be: Log is configured to *not* fsync() on all Append() calls
I20260807 07:55:33.548271 28013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be: No bootstrap required, opened a new log
I20260807 07:55:33.570842 28013 raft_consensus.cc:359] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1386f3207d446aea45efc277a5591be" member_type: VOTER }
I20260807 07:55:33.571477 28013 raft_consensus.cc:385] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:33.571693 28013 raft_consensus.cc:740] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1386f3207d446aea45efc277a5591be, State: Initialized, Role: FOLLOWER
I20260807 07:55:33.573239 28013 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1386f3207d446aea45efc277a5591be" member_type: VOTER }
I20260807 07:55:33.573824 28013 raft_consensus.cc:399] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:55:33.574124 28013 raft_consensus.cc:493] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:55:33.574462 28013 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:33.578576 28013 raft_consensus.cc:515] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1386f3207d446aea45efc277a5591be" member_type: VOTER }
I20260807 07:55:33.579588 28013 leader_election.cc:304] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1386f3207d446aea45efc277a5591be; no voters:
I20260807 07:55:33.581496 28013 leader_election.cc:290] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:55:33.581939 28019 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:55:33.584297 28019 raft_consensus.cc:697] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [term 1 LEADER]: Becoming Leader. State: Replica: c1386f3207d446aea45efc277a5591be, State: Running, Role: LEADER
I20260807 07:55:33.585287 28019 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1386f3207d446aea45efc277a5591be" member_type: VOTER }
I20260807 07:55:33.586391 28013 sys_catalog.cc:565] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:55:33.597280 28020 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1386f3207d446aea45efc277a5591be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1386f3207d446aea45efc277a5591be" member_type: VOTER } }
I20260807 07:55:33.598064 28020 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [sys.catalog]: This master's current role is: LEADER
I20260807 07:55:33.597426 28022 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1386f3207d446aea45efc277a5591be. Latest consensus state: current_term: 1 leader_uuid: "c1386f3207d446aea45efc277a5591be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1386f3207d446aea45efc277a5591be" member_type: VOTER } }
I20260807 07:55:33.599179 28022 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [sys.catalog]: This master's current role is: LEADER
I20260807 07:55:33.601262 28032 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260807 07:55:33.616410 28032 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260807 07:55:33.618842 27906 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 07:55:33.636420 28032 catalog_manager.cc:1383] Generated new cluster ID: 384076bc1537467aa389406d37c670fc
I20260807 07:55:33.636740 28032 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260807 07:55:33.659890 28032 catalog_manager.cc:1406] Generated new certificate authority record
I20260807 07:55:33.662036 28032 catalog_manager.cc:1540] Loading token signing keys...
I20260807 07:55:33.680306 28032 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be: Generated new TSK 0
I20260807 07:55:33.681686 28032 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260807 07:55:33.750025 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:55:33.759107 28047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:55:33.760456 28051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:55:33.763911 27906 server_base.cc:1061] running on GCE node
W20260807 07:55:33.764267 28054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:55:33.765196 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:55:33.765432 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:55:33.765597 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089333765582 us; error 0 us; skew 500 ppm
I20260807 07:55:33.766165 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:55:33.770108 27906 webserver.cc:533] Webserver started at http://127.27.64.129:41523/ using document root <none> and password file <none>
I20260807 07:55:33.770798 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:55:33.771046 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:55:33.771399 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:55:33.772923 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-0-root/instance:
uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
format_stamp: "Formatted at 2026-08-07 07:55:33 on dist-test-slave-f0tn"
I20260807 07:55:33.779851 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 07:55:33.784917 28059 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:55:33.785740 27906 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 07:55:33.786077 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-0-root
uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
format_stamp: "Formatted at 2026-08-07 07:55:33 on dist-test-slave-f0tn"
I20260807 07:55:33.786446 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:55:33.811502 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:55:33.813227 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:55:33.816210 27906 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 07:55:33.821985 27906 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:55:33.822371 27906 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:55:33.822687 27906 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 07:55:33.822921 27906 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:55:33.914852 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.129:34679
I20260807 07:55:33.914922 28154 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.129:34679 every 8 connection(s)
I20260807 07:55:33.923303 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:55:33.940277 28159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:55:33.942619 28160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:55:33.954511 28164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:55:33.955461 27906 server_base.cc:1061] running on GCE node
I20260807 07:55:33.956339 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:55:33.956532 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:55:33.956737 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089333956715 us; error 0 us; skew 500 ppm
I20260807 07:55:33.957353 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:55:33.962581 27906 webserver.cc:533] Webserver started at http://127.27.64.130:43149/ using document root <none> and password file <none>
I20260807 07:55:33.963220 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:55:33.963433 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:55:33.963706 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:55:33.964951 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-1-root/instance:
uuid: "6a39421d9b3449bda922edd1aecff9ee"
format_stamp: "Formatted at 2026-08-07 07:55:33 on dist-test-slave-f0tn"
I20260807 07:55:33.965142 28155 heartbeater.cc:344] Connected to a master server at 127.27.64.190:36165
I20260807 07:55:33.965776 28155 heartbeater.cc:461] Registering TS with master...
I20260807 07:55:33.967360 28155 heartbeater.cc:507] Master 127.27.64.190:36165 requested a full tablet report, sending...
I20260807 07:55:33.972066 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260807 07:55:33.972219 27958 ts_manager.cc:194] Registered new tserver with Master: 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679)
I20260807 07:55:33.975569 27958 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51218
I20260807 07:55:33.977494 28172 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:55:33.978515 27906 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260807 07:55:33.978848 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-1-root
uuid: "6a39421d9b3449bda922edd1aecff9ee"
format_stamp: "Formatted at 2026-08-07 07:55:33 on dist-test-slave-f0tn"
I20260807 07:55:33.979218 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:55:34.020663 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:55:34.022130 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:55:34.024351 27906 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 07:55:34.027787 27906 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:55:34.028000 27906 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:55:34.028249 27906 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 07:55:34.028395 27906 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:55:34.119947 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.130:35063
I20260807 07:55:34.120047 28265 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.130:35063 every 8 connection(s)
I20260807 07:55:34.131599 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:55:34.139914 28269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:55:34.142796 28270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:55:34.146159 28266 heartbeater.cc:344] Connected to a master server at 127.27.64.190:36165
I20260807 07:55:34.146602 28266 heartbeater.cc:461] Registering TS with master...
W20260807 07:55:34.147497 28272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:55:34.147845 28266 heartbeater.cc:507] Master 127.27.64.190:36165 requested a full tablet report, sending...
I20260807 07:55:34.148286 27906 server_base.cc:1061] running on GCE node
I20260807 07:55:34.149369 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:55:34.149622 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:55:34.149788 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089334149771 us; error 0 us; skew 500 ppm
I20260807 07:55:34.150483 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:55:34.150583 27958 ts_manager.cc:194] Registered new tserver with Master: 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:34.152398 27958 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51232
I20260807 07:55:34.153523 27906 webserver.cc:533] Webserver started at http://127.27.64.131:41253/ using document root <none> and password file <none>
I20260807 07:55:34.154157 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:55:34.154421 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:55:34.154769 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:55:34.155968 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-2-root/instance:
uuid: "c388fd85be3a4776aa66a26c350e91d9"
format_stamp: "Formatted at 2026-08-07 07:55:34 on dist-test-slave-f0tn"
I20260807 07:55:34.160861 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260807 07:55:34.164537 28280 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:55:34.165357 27906 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 07:55:34.165671 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-2-root
uuid: "c388fd85be3a4776aa66a26c350e91d9"
format_stamp: "Formatted at 2026-08-07 07:55:34 on dist-test-slave-f0tn"
I20260807 07:55:34.165946 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1786089331872967-27906-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:55:34.192334 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:55:34.193655 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:55:34.195014 27906 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 07:55:34.197132 27906 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:55:34.197329 27906 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:55:34.197614 27906 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 07:55:34.197778 27906 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:55:34.288450 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.131:38123
I20260807 07:55:34.288645 28367 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.131:38123 every 8 connection(s)
I20260807 07:55:34.307708 28369 heartbeater.cc:344] Connected to a master server at 127.27.64.190:36165
I20260807 07:55:34.308079 28369 heartbeater.cc:461] Registering TS with master...
I20260807 07:55:34.308962 28369 heartbeater.cc:507] Master 127.27.64.190:36165 requested a full tablet report, sending...
I20260807 07:55:34.311074 27958 ts_manager.cc:194] Registered new tserver with Master: c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:34.311230 27906 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01340649s
I20260807 07:55:34.312788 27958 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51246
I20260807 07:55:34.377409 27958 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51254:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 07:55:34.383951 27958 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 07:55:34.487823 28206 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca541804d2a4d4884620e683ea84d9b (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 07:55:34.490334 28209 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9566c0c8cb4919bf24d678583f9eed (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 07:55:34.492100 28210 tablet_service.cc:1511] Processing CreateTablet for tablet 00c2297df5ee409099f88f389a23e956 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 07:55:34.493100 28322 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9566c0c8cb4919bf24d678583f9eed (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 07:55:34.494031 28209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9566c0c8cb4919bf24d678583f9eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.487811 28325 tablet_service.cc:1511] Processing CreateTablet for tablet 00c2297df5ee409099f88f389a23e956 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 07:55:34.495770 28210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00c2297df5ee409099f88f389a23e956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.496240 28322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9566c0c8cb4919bf24d678583f9eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.496573 28206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca541804d2a4d4884620e683ea84d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.501777 28106 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9566c0c8cb4919bf24d678583f9eed (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260807 07:55:34.500950 28325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00c2297df5ee409099f88f389a23e956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.502655 28108 tablet_service.cc:1511] Processing CreateTablet for tablet 00c2297df5ee409099f88f389a23e956 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260807 07:55:34.504215 28106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9566c0c8cb4919bf24d678583f9eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.502731 28105 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca541804d2a4d4884620e683ea84d9b (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 07:55:34.509013 28321 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca541804d2a4d4884620e683ea84d9b (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260807 07:55:34.515794 28321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca541804d2a4d4884620e683ea84d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.519183 28205 tablet_service.cc:1511] Processing CreateTablet for tablet f7d39b5c315e4109b13d54ab02326c57 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 07:55:34.523133 28104 tablet_service.cc:1511] Processing CreateTablet for tablet f7d39b5c315e4109b13d54ab02326c57 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 07:55:34.517015 28108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00c2297df5ee409099f88f389a23e956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.526293 28205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7d39b5c315e4109b13d54ab02326c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.528324 28104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7d39b5c315e4109b13d54ab02326c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.529582 28105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca541804d2a4d4884620e683ea84d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.552397 28320 tablet_service.cc:1511] Processing CreateTablet for tablet f7d39b5c315e4109b13d54ab02326c57 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260807 07:55:34.554986 28320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7d39b5c315e4109b13d54ab02326c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.555080 28204 tablet_service.cc:1511] Processing CreateTablet for tablet 19531b49699549f988681ad93f142486 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 07:55:34.556499 28204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19531b49699549f988681ad93f142486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.558689 28103 tablet_service.cc:1511] Processing CreateTablet for tablet 19531b49699549f988681ad93f142486 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 07:55:34.569480 28103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19531b49699549f988681ad93f142486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.586594 28319 tablet_service.cc:1511] Processing CreateTablet for tablet 19531b49699549f988681ad93f142486 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260807 07:55:34.588804 28319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19531b49699549f988681ad93f142486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.600715 28099 tablet_service.cc:1511] Processing CreateTablet for tablet a4a69e9c16e04008a145d51b5c038be8 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 07:55:34.613333 28099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a69e9c16e04008a145d51b5c038be8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 07:55:34.614266 28033 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:55:34.615095 28394 tablet_bootstrap.cc:492] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee: Bootstrap starting.
I20260807 07:55:34.628687 28209 tablet_service.cc:1511] Processing CreateTablet for tablet a4a69e9c16e04008a145d51b5c038be8 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 07:55:34.630191 28209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a69e9c16e04008a145d51b5c038be8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.635898 28394 tablet_bootstrap.cc:654] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.639024 28318 tablet_service.cc:1511] Processing CreateTablet for tablet a4a69e9c16e04008a145d51b5c038be8 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260807 07:55:34.660431 28318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a69e9c16e04008a145d51b5c038be8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.639844 28105 tablet_service.cc:1511] Processing CreateTablet for tablet b4e6d12080cd481e95ea126f9ba401f9 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 07:55:34.641767 28204 tablet_service.cc:1511] Processing CreateTablet for tablet b4e6d12080cd481e95ea126f9ba401f9 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 07:55:34.662209 28204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4e6d12080cd481e95ea126f9ba401f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.645344 28395 tablet_bootstrap.cc:492] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c: Bootstrap starting.
I20260807 07:55:34.656741 28317 tablet_service.cc:1511] Processing CreateTablet for tablet b4e6d12080cd481e95ea126f9ba401f9 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260807 07:55:34.665745 28317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4e6d12080cd481e95ea126f9ba401f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.662209 28105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4e6d12080cd481e95ea126f9ba401f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.675884 28104 tablet_service.cc:1511] Processing CreateTablet for tablet c61ff273d6be468982ab05bb74f43355 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 07:55:34.671809 28206 tablet_service.cc:1511] Processing CreateTablet for tablet c61ff273d6be468982ab05bb74f43355 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 07:55:34.677911 28397 tablet_bootstrap.cc:492] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9: Bootstrap starting.
I20260807 07:55:34.683972 28104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61ff273d6be468982ab05bb74f43355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.682878 28206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61ff273d6be468982ab05bb74f43355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.703225 28322 tablet_service.cc:1511] Processing CreateTablet for tablet c61ff273d6be468982ab05bb74f43355 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260807 07:55:34.704715 28395 tablet_bootstrap.cc:654] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.705142 28103 tablet_service.cc:1511] Processing CreateTablet for tablet 8349b1da04e043bc856961aee4297ea8 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 07:55:34.707608 28397 tablet_bootstrap.cc:654] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.706594 28103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8349b1da04e043bc856961aee4297ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.710114 28322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61ff273d6be468982ab05bb74f43355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.712464 28394 tablet_bootstrap.cc:492] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee: No bootstrap required, opened a new log
I20260807 07:55:34.713737 28394 ts_tablet_manager.cc:1403] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee: Time spent bootstrapping tablet: real 0.103s user 0.005s sys 0.011s
I20260807 07:55:34.713043 28209 tablet_service.cc:1511] Processing CreateTablet for tablet 8349b1da04e043bc856961aee4297ea8 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 07:55:34.715184 28209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8349b1da04e043bc856961aee4297ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.717593 28394 raft_consensus.cc:359] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.718539 28394 raft_consensus.cc:385] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:34.718889 28394 raft_consensus.cc:740] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Initialized, Role: FOLLOWER
I20260807 07:55:34.719739 28394 consensus_queue.cc:260] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.726616 28319 tablet_service.cc:1511] Processing CreateTablet for tablet 8349b1da04e043bc856961aee4297ea8 (DEFAULT_TABLE table=test-workload [id=23a805ef25f54646a05c4396f81f38a5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260807 07:55:34.727877 28319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8349b1da04e043bc856961aee4297ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:55:34.759531 28397 tablet_bootstrap.cc:492] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9: No bootstrap required, opened a new log
I20260807 07:55:34.760075 28397 ts_tablet_manager.cc:1403] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9: Time spent bootstrapping tablet: real 0.085s user 0.016s sys 0.006s
I20260807 07:55:34.762238 28266 heartbeater.cc:499] Master 127.27.64.190:36165 was elected leader, sending a full tablet report...
I20260807 07:55:34.762766 28395 tablet_bootstrap.cc:492] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c: No bootstrap required, opened a new log
I20260807 07:55:34.762795 28394 ts_tablet_manager.cc:1434] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee: Time spent starting tablet: real 0.049s user 0.016s sys 0.007s
I20260807 07:55:34.763415 28395 ts_tablet_manager.cc:1403] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent bootstrapping tablet: real 0.118s user 0.009s sys 0.020s
I20260807 07:55:34.764073 28394 tablet_bootstrap.cc:492] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee: Bootstrap starting.
I20260807 07:55:34.782984 28395 raft_consensus.cc:359] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.783567 28397 raft_consensus.cc:359] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.786718 28394 tablet_bootstrap.cc:654] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.787047 28395 raft_consensus.cc:385] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:34.787213 28397 raft_consensus.cc:385] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:34.787710 28397 raft_consensus.cc:740] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Initialized, Role: FOLLOWER
I20260807 07:55:34.788621 28395 raft_consensus.cc:740] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Initialized, Role: FOLLOWER
I20260807 07:55:34.788640 28397 consensus_queue.cc:260] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.789479 28395 consensus_queue.cc:260] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.803182 28394 tablet_bootstrap.cc:492] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee: No bootstrap required, opened a new log
I20260807 07:55:34.804050 28369 heartbeater.cc:499] Master 127.27.64.190:36165 was elected leader, sending a full tablet report...
I20260807 07:55:34.806654 28397 ts_tablet_manager.cc:1434] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9: Time spent starting tablet: real 0.046s user 0.004s sys 0.021s
I20260807 07:55:34.807659 28397 tablet_bootstrap.cc:492] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9: Bootstrap starting.
I20260807 07:55:34.813778 28397 tablet_bootstrap.cc:654] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.803694 28394 ts_tablet_manager.cc:1403] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee: Time spent bootstrapping tablet: real 0.040s user 0.011s sys 0.003s
I20260807 07:55:34.818068 28155 heartbeater.cc:499] Master 127.27.64.190:36165 was elected leader, sending a full tablet report...
I20260807 07:55:34.818625 28395 ts_tablet_manager.cc:1434] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent starting tablet: real 0.055s user 0.010s sys 0.008s
I20260807 07:55:34.819516 28395 tablet_bootstrap.cc:492] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c: Bootstrap starting.
I20260807 07:55:34.819118 28394 raft_consensus.cc:359] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.819849 28394 raft_consensus.cc:385] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:34.820139 28394 raft_consensus.cc:740] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Initialized, Role: FOLLOWER
I20260807 07:55:34.820968 28394 consensus_queue.cc:260] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.824872 28394 ts_tablet_manager.cc:1434] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260807 07:55:34.825814 28394 tablet_bootstrap.cc:492] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee: Bootstrap starting.
I20260807 07:55:34.828794 28395 tablet_bootstrap.cc:654] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.830683 28397 tablet_bootstrap.cc:492] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9: No bootstrap required, opened a new log
I20260807 07:55:34.831223 28397 ts_tablet_manager.cc:1403] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.002s
I20260807 07:55:34.834203 28397 raft_consensus.cc:359] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.835135 28397 raft_consensus.cc:385] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:34.835512 28397 raft_consensus.cc:740] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Initialized, Role: FOLLOWER
I20260807 07:55:34.836318 28397 consensus_queue.cc:260] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.841565 28397 ts_tablet_manager.cc:1434] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260807 07:55:34.842562 28397 tablet_bootstrap.cc:492] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9: Bootstrap starting.
I20260807 07:55:34.844835 28394 tablet_bootstrap.cc:654] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.849238 28397 tablet_bootstrap.cc:654] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.856973 28395 tablet_bootstrap.cc:492] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c: No bootstrap required, opened a new log
I20260807 07:55:34.857371 28394 tablet_bootstrap.cc:492] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee: No bootstrap required, opened a new log
I20260807 07:55:34.857471 28395 ts_tablet_manager.cc:1403] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent bootstrapping tablet: real 0.038s user 0.017s sys 0.000s
I20260807 07:55:34.857964 28394 ts_tablet_manager.cc:1403] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.005s
I20260807 07:55:34.861204 28394 raft_consensus.cc:359] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.862072 28394 raft_consensus.cc:385] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:34.862443 28394 raft_consensus.cc:740] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Initialized, Role: FOLLOWER
I20260807 07:55:34.862999 28395 raft_consensus.cc:359] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.863744 28395 raft_consensus.cc:385] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:34.863379 28394 consensus_queue.cc:260] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.864074 28395 raft_consensus.cc:740] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Initialized, Role: FOLLOWER
I20260807 07:55:34.866007 28397 tablet_bootstrap.cc:492] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9: No bootstrap required, opened a new log
I20260807 07:55:34.866024 28394 ts_tablet_manager.cc:1434] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260807 07:55:34.866647 28397 ts_tablet_manager.cc:1403] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.005s
I20260807 07:55:34.867246 28394 tablet_bootstrap.cc:492] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee: Bootstrap starting.
I20260807 07:55:34.869895 28397 raft_consensus.cc:359] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.870688 28397 raft_consensus.cc:385] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:34.871062 28397 raft_consensus.cc:740] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Initialized, Role: FOLLOWER
I20260807 07:55:34.872045 28397 consensus_queue.cc:260] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.874555 28394 tablet_bootstrap.cc:654] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.877079 28395 consensus_queue.cc:260] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.874521 28397 ts_tablet_manager.cc:1434] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20260807 07:55:34.879480 28397 tablet_bootstrap.cc:492] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9: Bootstrap starting.
W20260807 07:55:34.881834 28267 tablet.cc:2406] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:55:34.886327 28397 tablet_bootstrap.cc:654] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.889305 28394 tablet_bootstrap.cc:492] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee: No bootstrap required, opened a new log
I20260807 07:55:34.889802 28394 ts_tablet_manager.cc:1403] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee: Time spent bootstrapping tablet: real 0.023s user 0.014s sys 0.000s
I20260807 07:55:34.892452 28395 ts_tablet_manager.cc:1434] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent starting tablet: real 0.035s user 0.004s sys 0.001s
I20260807 07:55:34.892535 28394 raft_consensus.cc:359] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.893326 28394 raft_consensus.cc:385] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:34.893630 28394 raft_consensus.cc:740] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Initialized, Role: FOLLOWER
I20260807 07:55:34.894301 28394 consensus_queue.cc:260] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.898290 28394 ts_tablet_manager.cc:1434] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 07:55:34.899281 28394 tablet_bootstrap.cc:492] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee: Bootstrap starting.
I20260807 07:55:34.900924 28395 tablet_bootstrap.cc:492] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c: Bootstrap starting.
I20260807 07:55:34.907128 28397 tablet_bootstrap.cc:492] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9: No bootstrap required, opened a new log
I20260807 07:55:34.907639 28397 ts_tablet_manager.cc:1403] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9: Time spent bootstrapping tablet: real 0.028s user 0.014s sys 0.002s
I20260807 07:55:34.911525 28395 tablet_bootstrap.cc:654] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.911194 28397 raft_consensus.cc:359] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.912114 28397 raft_consensus.cc:385] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:34.912501 28397 raft_consensus.cc:740] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Initialized, Role: FOLLOWER
I20260807 07:55:34.913508 28394 tablet_bootstrap.cc:654] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.913518 28397 consensus_queue.cc:260] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.916538 28397 ts_tablet_manager.cc:1434] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9: Time spent starting tablet: real 0.009s user 0.004s sys 0.005s
I20260807 07:55:34.917884 28397 tablet_bootstrap.cc:492] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9: Bootstrap starting.
I20260807 07:55:34.925088 28397 tablet_bootstrap.cc:654] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.928603 28395 tablet_bootstrap.cc:492] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c: No bootstrap required, opened a new log
I20260807 07:55:34.929169 28395 ts_tablet_manager.cc:1403] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent bootstrapping tablet: real 0.028s user 0.009s sys 0.013s
I20260807 07:55:34.932588 28395 raft_consensus.cc:359] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.933516 28395 raft_consensus.cc:385] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:34.933900 28395 raft_consensus.cc:740] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Initialized, Role: FOLLOWER
I20260807 07:55:34.934970 28395 consensus_queue.cc:260] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.938356 28397 tablet_bootstrap.cc:492] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9: No bootstrap required, opened a new log
I20260807 07:55:34.938907 28397 ts_tablet_manager.cc:1403] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9: Time spent bootstrapping tablet: real 0.021s user 0.012s sys 0.006s
I20260807 07:55:34.940176 28395 ts_tablet_manager.cc:1434] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent starting tablet: real 0.011s user 0.001s sys 0.005s
I20260807 07:55:34.941998 28397 raft_consensus.cc:359] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.943331 28397 raft_consensus.cc:385] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:34.943748 28397 raft_consensus.cc:740] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Initialized, Role: FOLLOWER
I20260807 07:55:34.944051 28394 tablet_bootstrap.cc:492] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee: No bootstrap required, opened a new log
I20260807 07:55:34.944547 28394 ts_tablet_manager.cc:1403] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee: Time spent bootstrapping tablet: real 0.045s user 0.013s sys 0.010s
I20260807 07:55:34.944608 28397 consensus_queue.cc:260] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.947329 28397 ts_tablet_manager.cc:1434] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9: Time spent starting tablet: real 0.008s user 0.001s sys 0.005s
I20260807 07:55:34.948336 28397 tablet_bootstrap.cc:492] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9: Bootstrap starting.
I20260807 07:55:34.950223 28394 raft_consensus.cc:359] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.950973 28394 raft_consensus.cc:385] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:34.951295 28394 raft_consensus.cc:740] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Initialized, Role: FOLLOWER
I20260807 07:55:34.952081 28394 consensus_queue.cc:260] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.955015 28397 tablet_bootstrap.cc:654] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.955436 28395 tablet_bootstrap.cc:492] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c: Bootstrap starting.
I20260807 07:55:34.960803 28404 raft_consensus.cc:493] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:34.961264 28404 raft_consensus.cc:515] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.965935 28404 leader_election.cc:290] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:34.967890 28395 tablet_bootstrap.cc:654] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:34.971836 28394 ts_tablet_manager.cc:1434] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee: Time spent starting tablet: real 0.027s user 0.006s sys 0.001s
I20260807 07:55:34.975994 28394 tablet_bootstrap.cc:492] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee: Bootstrap starting.
I20260807 07:55:34.982513 28408 raft_consensus.cc:493] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:34.983124 28408 raft_consensus.cc:515] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:34.994175 28404 raft_consensus.cc:493] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:34.999068 28408 leader_election.cc:290] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:34.999866 28404 raft_consensus.cc:515] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.012405 28397 tablet_bootstrap.cc:492] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9: No bootstrap required, opened a new log
I20260807 07:55:35.012969 28397 ts_tablet_manager.cc:1403] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9: Time spent bootstrapping tablet: real 0.065s user 0.006s sys 0.012s
I20260807 07:55:35.023990 28404 leader_election.cc:290] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.025305 28397 raft_consensus.cc:359] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.026189 28394 tablet_bootstrap.cc:654] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:35.026578 28397 raft_consensus.cc:385] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.027878 28397 raft_consensus.cc:740] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Initialized, Role: FOLLOWER
I20260807 07:55:35.028908 28397 consensus_queue.cc:260] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.030917 28407 raft_consensus.cc:493] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.031370 28407 raft_consensus.cc:515] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.034773 28407 leader_election.cc:290] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:35.037147 28395 tablet_bootstrap.cc:492] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c: No bootstrap required, opened a new log
I20260807 07:55:35.042071 28407 raft_consensus.cc:493] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.044144 28395 ts_tablet_manager.cc:1403] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent bootstrapping tablet: real 0.098s user 0.014s sys 0.024s
I20260807 07:55:35.044302 28407 raft_consensus.cc:515] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.046845 28407 leader_election.cc:290] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:35.046758 28124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c2297df5ee409099f88f389a23e956" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.047748 28397 ts_tablet_manager.cc:1434] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9: Time spent starting tablet: real 0.034s user 0.010s sys 0.000s
I20260807 07:55:35.047798 28395 raft_consensus.cc:359] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.048969 28395 raft_consensus.cc:385] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.049710 28395 raft_consensus.cc:740] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Initialized, Role: FOLLOWER
I20260807 07:55:35.050724 28395 consensus_queue.cc:260] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.049055 28397 tablet_bootstrap.cc:492] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9: Bootstrap starting.
I20260807 07:55:35.049642 28122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.043275 28408 raft_consensus.cc:493] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:55:35.054275 28173 leader_election.cc:343] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.054525 28408 raft_consensus.cc:515] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.072520 28122 raft_consensus.cc:2468] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 0.
I20260807 07:55:35.091486 28407 raft_consensus.cc:493] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.099581 28407 raft_consensus.cc:515] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.103688 28407 leader_election.cc:290] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679)
I20260807 07:55:35.109549 28173 leader_election.cc:304] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee; no voters:
I20260807 07:55:35.110417 28404 raft_consensus.cc:2804] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:55:35.110749 28404 raft_consensus.cc:493] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:35.112318 28408 leader_election.cc:290] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.111043 28404 raft_consensus.cc:3060] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.130947 28436 raft_consensus.cc:493] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.133631 28397 tablet_bootstrap.cc:654] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:35.133826 28395 ts_tablet_manager.cc:1434] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent starting tablet: real 0.089s user 0.007s sys 0.002s
I20260807 07:55:35.137960 28394 tablet_bootstrap.cc:492] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee: No bootstrap required, opened a new log
I20260807 07:55:35.137830 28337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9566c0c8cb4919bf24d678583f9eed" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:35.139577 28395 tablet_bootstrap.cc:492] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c: Bootstrap starting.
I20260807 07:55:35.139763 28394 ts_tablet_manager.cc:1403] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee: Time spent bootstrapping tablet: real 0.164s user 0.008s sys 0.021s
I20260807 07:55:35.141338 28336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:35.143510 28124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.143589 28336 raft_consensus.cc:2468] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 0.
I20260807 07:55:35.141340 28122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.146196 28122 raft_consensus.cc:2468] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 0.
I20260807 07:55:35.146790 28394 raft_consensus.cc:359] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.147478 28394 raft_consensus.cc:385] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.147779 28394 raft_consensus.cc:740] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Initialized, Role: FOLLOWER
I20260807 07:55:35.148491 28394 consensus_queue.cc:260] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.151234 28063 leader_election.cc:304] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:35.154493 28122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c2297df5ee409099f88f389a23e956" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.155591 28122 raft_consensus.cc:2468] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 0.
I20260807 07:55:35.135458 28436 raft_consensus.cc:515] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
W20260807 07:55:35.157958 28284 leader_election.cc:343] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.159312 28440 raft_consensus.cc:2804] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:55:35.158993 28337 raft_consensus.cc:2468] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 0.
I20260807 07:55:35.160631 28284 leader_election.cc:304] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:35.161885 28407 raft_consensus.cc:2804] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:55:35.162019 28284 leader_election.cc:304] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:35.162292 28407 raft_consensus.cc:493] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:35.163123 28063 leader_election.cc:304] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:35.162667 28407 raft_consensus.cc:3060] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.164680 28408 raft_consensus.cc:2804] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:55:35.165663 28408 raft_consensus.cc:493] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:35.163182 28440 raft_consensus.cc:493] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:35.167125 28408 raft_consensus.cc:3060] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.165505 28227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9566c0c8cb4919bf24d678583f9eed" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee" is_pre_election: true
I20260807 07:55:35.168990 28440 raft_consensus.cc:3060] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.169160 28225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee" is_pre_election: true
I20260807 07:55:35.169291 28227 raft_consensus.cc:2468] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 0.
I20260807 07:55:35.172159 28404 raft_consensus.cc:515] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.177898 28407 raft_consensus.cc:515] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.183248 28225 raft_consensus.cc:2393] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 52333cbb1cf7443a959e5bb2f7f3069c in current term 1: Already voted for candidate 6a39421d9b3449bda922edd1aecff9ee in this term.
I20260807 07:55:35.198402 28407 leader_election.cc:290] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:35.203258 28337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c2297df5ee409099f88f389a23e956" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:35.203842 28336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:35.204785 28336 raft_consensus.cc:2393] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a39421d9b3449bda922edd1aecff9ee in current term 1: Already voted for candidate c388fd85be3a4776aa66a26c350e91d9 in this term.
I20260807 07:55:35.201822 28407 raft_consensus.cc:2804] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:55:35.196851 28436 leader_election.cc:290] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:35.214046 28407 raft_consensus.cc:493] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:35.220490 28407 raft_consensus.cc:3060] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.207700 28408 raft_consensus.cc:515] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
W20260807 07:55:35.206943 28284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:34679, user_credentials={real_user=slave}} blocked reactor thread for 45000.1us
I20260807 07:55:35.216207 28404 leader_election.cc:290] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.236809 28336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:35.237598 28336 raft_consensus.cc:2393] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6a39421d9b3449bda922edd1aecff9ee in current term 1: Already voted for candidate c388fd85be3a4776aa66a26c350e91d9 in this term.
I20260807 07:55:35.239529 28397 tablet_bootstrap.cc:492] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9: No bootstrap required, opened a new log
I20260807 07:55:35.240963 28397 ts_tablet_manager.cc:1403] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9: Time spent bootstrapping tablet: real 0.192s user 0.018s sys 0.028s
I20260807 07:55:35.240689 28404 raft_consensus.cc:493] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.243713 28122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9566c0c8cb4919bf24d678583f9eed" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.244228 28442 raft_consensus.cc:493] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.244553 28122 raft_consensus.cc:2393] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c388fd85be3a4776aa66a26c350e91d9 in current term 1: Already voted for candidate 52333cbb1cf7443a959e5bb2f7f3069c in this term.
I20260807 07:55:35.245321 28395 tablet_bootstrap.cc:654] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:35.245582 28124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:35.241966 28404 raft_consensus.cc:515] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.250753 28443 raft_consensus.cc:493] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.247584 28436 raft_consensus.cc:493] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.250869 28407 raft_consensus.cc:515] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.254563 28122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:35.255993 28337 raft_consensus.cc:2393] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a39421d9b3449bda922edd1aecff9ee in current term 1: Already voted for candidate c388fd85be3a4776aa66a26c350e91d9 in this term.
I20260807 07:55:35.256839 28407 leader_election.cc:290] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 election: Requested vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679)
I20260807 07:55:35.252965 28408 leader_election.cc:290] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 election: Requested vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.258034 28173 leader_election.cc:304] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee; no voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:35.259761 28336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9566c0c8cb4919bf24d678583f9eed" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:35.261439 28447 raft_consensus.cc:2749] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 07:55:35.261605 28225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9566c0c8cb4919bf24d678583f9eed" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:35.247295 28442 raft_consensus.cc:515] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.260370 28336 raft_consensus.cc:3060] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.252796 28436 raft_consensus.cc:515] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.262475 28225 raft_consensus.cc:3060] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.257475 28440 raft_consensus.cc:515] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.268492 28122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.251619 28443 raft_consensus.cc:515] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.268744 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c2297df5ee409099f88f389a23e956" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:35.270275 28121 raft_consensus.cc:3060] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.271457 28124 raft_consensus.cc:2393] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c388fd85be3a4776aa66a26c350e91d9 in current term 1: Already voted for candidate 52333cbb1cf7443a959e5bb2f7f3069c in this term.
I20260807 07:55:35.271152 28442 leader_election.cc:290] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.269773 28404 leader_election.cc:290] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.276296 28397 raft_consensus.cc:359] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.276994 28397 raft_consensus.cc:385] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.277786 28440 leader_election.cc:290] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 election: Requested vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.279222 28337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
W20260807 07:55:35.279608 28173 leader_election.cc:343] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.280412 28337 raft_consensus.cc:2393] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 52333cbb1cf7443a959e5bb2f7f3069c in current term 1: Already voted for candidate c388fd85be3a4776aa66a26c350e91d9 in this term.
I20260807 07:55:35.280405 28443 leader_election.cc:290] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.281152 28124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9566c0c8cb4919bf24d678583f9eed" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.281898 28124 raft_consensus.cc:2393] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a39421d9b3449bda922edd1aecff9ee in current term 1: Already voted for candidate 52333cbb1cf7443a959e5bb2f7f3069c in this term.
I20260807 07:55:35.282979 28122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19531b49699549f988681ad93f142486" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.278506 28394 ts_tablet_manager.cc:1434] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee: Time spent starting tablet: real 0.136s user 0.011s sys 0.022s
I20260807 07:55:35.277292 28397 raft_consensus.cc:740] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Initialized, Role: FOLLOWER
W20260807 07:55:35.286466 28173 leader_election.cc:343] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.286949 28397 consensus_queue.cc:260] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.289202 28397 ts_tablet_manager.cc:1434] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9: Time spent starting tablet: real 0.047s user 0.005s sys 0.000s
I20260807 07:55:35.290164 28407 raft_consensus.cc:493] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.290874 28394 tablet_bootstrap.cc:492] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee: Bootstrap starting.
I20260807 07:55:35.290616 28407 raft_consensus.cc:515] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.290076 28225 raft_consensus.cc:2468] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 1.
I20260807 07:55:35.283838 28176 leader_election.cc:304] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee; no voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:35.292591 28407 leader_election.cc:290] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:35.292593 28436 leader_election.cc:290] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:35.290161 28397 tablet_bootstrap.cc:492] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9: Bootstrap starting.
I20260807 07:55:35.297617 28443 raft_consensus.cc:3060] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.298012 28124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e6d12080cd481e95ea126f9ba401f9" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.299055 28337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
W20260807 07:55:35.299274 28284 leader_election.cc:343] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.299688 28337 raft_consensus.cc:2468] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 0.
I20260807 07:55:35.300634 28122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61ff273d6be468982ab05bb74f43355" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
W20260807 07:55:35.307096 28284 leader_election.cc:343] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.309417 28395 tablet_bootstrap.cc:492] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c: No bootstrap required, opened a new log
I20260807 07:55:35.307209 28227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee" is_pre_election: true
I20260807 07:55:35.310369 28395 ts_tablet_manager.cc:1403] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent bootstrapping tablet: real 0.172s user 0.020s sys 0.006s
I20260807 07:55:35.314742 28394 tablet_bootstrap.cc:654] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:35.313866 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19531b49699549f988681ad93f142486" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:35.316895 28335 raft_consensus.cc:2468] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 0.
I20260807 07:55:35.313934 28337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9566c0c8cb4919bf24d678583f9eed" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:35.313858 28227 raft_consensus.cc:2468] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 0.
I20260807 07:55:35.316852 28223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:35.315645 28225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee" is_pre_election: true
I20260807 07:55:35.319864 28223 raft_consensus.cc:2393] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 52333cbb1cf7443a959e5bb2f7f3069c in current term 1: Already voted for candidate 6a39421d9b3449bda922edd1aecff9ee in this term.
I20260807 07:55:35.322185 28227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c2297df5ee409099f88f389a23e956" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee" is_pre_election: true
I20260807 07:55:35.323262 28062 leader_election.cc:304] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee; no voters:
I20260807 07:55:35.324103 28440 raft_consensus.cc:2804] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:55:35.324326 28062 leader_election.cc:304] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c; no voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:35.324620 28440 raft_consensus.cc:697] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 LEADER]: Becoming Leader. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Running, Role: LEADER
I20260807 07:55:35.317492 28443 raft_consensus.cc:2749] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:55:35.325730 28440 consensus_queue.cc:237] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.328008 28121 raft_consensus.cc:2468] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 1.
I20260807 07:55:35.329538 28408 raft_consensus.cc:2749] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 07:55:35.330400 28284 leader_election.cc:304] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:35.331359 28436 raft_consensus.cc:2804] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:55:35.331847 28436 raft_consensus.cc:697] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 1 LEADER]: Becoming Leader. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Running, Role: LEADER
I20260807 07:55:35.334147 28436 consensus_queue.cc:237] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.330540 28336 raft_consensus.cc:2468] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 1.
I20260807 07:55:35.335670 28223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:35.332228 28227 raft_consensus.cc:2468] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 1.
I20260807 07:55:35.337013 28225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9566c0c8cb4919bf24d678583f9eed" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee" is_pre_election: true
I20260807 07:55:35.339717 28221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61ff273d6be468982ab05bb74f43355" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee" is_pre_election: true
I20260807 07:55:35.341642 28397 tablet_bootstrap.cc:654] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:35.337476 28222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c2297df5ee409099f88f389a23e956" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:35.340704 28223 raft_consensus.cc:2393] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c388fd85be3a4776aa66a26c350e91d9 in current term 1: Already voted for candidate 6a39421d9b3449bda922edd1aecff9ee in this term.
I20260807 07:55:35.349009 28225 raft_consensus.cc:2393] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c388fd85be3a4776aa66a26c350e91d9 in current term 1: Already voted for candidate 52333cbb1cf7443a959e5bb2f7f3069c in this term.
I20260807 07:55:35.349597 28221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e6d12080cd481e95ea126f9ba401f9" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee" is_pre_election: true
I20260807 07:55:35.351016 28394 tablet_bootstrap.cc:492] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee: No bootstrap required, opened a new log
I20260807 07:55:35.352699 28176 leader_election.cc:304] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters: 52333cbb1cf7443a959e5bb2f7f3069c
I20260807 07:55:35.355695 28394 ts_tablet_manager.cc:1403] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee: Time spent bootstrapping tablet: real 0.065s user 0.007s sys 0.014s
I20260807 07:55:35.357703 27958 catalog_manager.cc:5697] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c reported cstate change: term changed from 0 to 1, leader changed from <none> to 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129). New cstate: current_term: 1 leader_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:35.359712 28176 leader_election.cc:304] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters: 52333cbb1cf7443a959e5bb2f7f3069c
I20260807 07:55:35.359898 28440 raft_consensus.cc:493] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.347503 28395 raft_consensus.cc:359] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.359160 28443 raft_consensus.cc:2804] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:55:35.360702 28442 raft_consensus.cc:2804] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:55:35.361814 28442 raft_consensus.cc:493] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:35.360706 28440 raft_consensus.cc:515] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.356292 28222 raft_consensus.cc:2468] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 1.
I20260807 07:55:35.359020 28394 raft_consensus.cc:359] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.359076 27955 catalog_manager.cc:5697] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131). New cstate: current_term: 1 leader_uuid: "c388fd85be3a4776aa66a26c350e91d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: HEALTHY } } }
I20260807 07:55:35.361436 28443 raft_consensus.cc:493] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:35.362164 28442 raft_consensus.cc:3060] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.364961 28440 leader_election.cc:290] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.361235 28395 raft_consensus.cc:385] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.371369 28336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a69e9c16e04008a145d51b5c038be8" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:35.372053 28395 raft_consensus.cc:740] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Initialized, Role: FOLLOWER
W20260807 07:55:35.373025 28063 leader_election.cc:343] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.373137 28395 consensus_queue.cc:260] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.364939 28443 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.377162 28176 leader_election.cc:304] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee; no voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:35.378561 28395 ts_tablet_manager.cc:1434] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent starting tablet: real 0.064s user 0.006s sys 0.001s
I20260807 07:55:35.378504 28404 raft_consensus.cc:2749] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:55:35.379344 28287 leader_election.cc:304] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters: 52333cbb1cf7443a959e5bb2f7f3069c
I20260807 07:55:35.364737 28394 raft_consensus.cc:385] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.380213 28395 tablet_bootstrap.cc:492] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c: Bootstrap starting.
I20260807 07:55:35.380481 28436 raft_consensus.cc:2804] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:55:35.380839 28436 raft_consensus.cc:493] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:35.380115 28394 raft_consensus.cc:740] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Initialized, Role: FOLLOWER
I20260807 07:55:35.381151 28436 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.381774 28394 consensus_queue.cc:260] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.383595 28222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a69e9c16e04008a145d51b5c038be8" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee" is_pre_election: true
I20260807 07:55:35.385435 28222 raft_consensus.cc:2468] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 0.
I20260807 07:55:35.385365 28442 raft_consensus.cc:515] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.387480 28062 leader_election.cc:304] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee; no voters: c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:35.388819 28440 raft_consensus.cc:2804] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:55:35.389242 28440 raft_consensus.cc:493] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:35.390398 28394 ts_tablet_manager.cc:1434] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee: Time spent starting tablet: real 0.034s user 0.006s sys 0.000s
I20260807 07:55:35.393532 28440 raft_consensus.cc:3060] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.398265 28394 tablet_bootstrap.cc:492] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee: Bootstrap starting.
I20260807 07:55:35.399379 28436 raft_consensus.cc:515] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.393193 28443 raft_consensus.cc:515] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.402339 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
W20260807 07:55:35.403203 28287 leader_election.cc:343] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.404040 28287 leader_election.cc:304] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c388fd85be3a4776aa66a26c350e91d9; no voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee
W20260807 07:55:35.403918 28284 leader_election.cc:343] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.404819 28407 raft_consensus.cc:2749] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:55:35.404851 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:35.406070 28440 raft_consensus.cc:515] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
W20260807 07:55:35.406314 28173 leader_election.cc:343] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.406365 28287 leader_election.cc:304] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c388fd85be3a4776aa66a26c350e91d9; no voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee
I20260807 07:55:35.407197 28407 raft_consensus.cc:2749] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260807 07:55:35.407575 28287 leader_election.cc:343] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.407989 28287 leader_election.cc:304] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c388fd85be3a4776aa66a26c350e91d9; no voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee
I20260807 07:55:35.408667 28436 leader_election.cc:290] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:35.408711 28407 raft_consensus.cc:2749] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:55:35.409798 28443 leader_election.cc:290] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.410904 28336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:35.411659 28336 raft_consensus.cc:2393] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6a39421d9b3449bda922edd1aecff9ee in current term 1: Already voted for candidate c388fd85be3a4776aa66a26c350e91d9 in this term.
I20260807 07:55:35.409140 28287 leader_election.cc:304] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c388fd85be3a4776aa66a26c350e91d9; no voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee
I20260807 07:55:35.416074 28407 raft_consensus.cc:2749] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:55:35.416438 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19531b49699549f988681ad93f142486" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:35.416985 28121 raft_consensus.cc:3060] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.425590 28442 leader_election.cc:290] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.412984 28176 leader_election.cc:304] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee; no voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:35.430295 28394 tablet_bootstrap.cc:654] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:35.431015 28442 raft_consensus.cc:2749] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 07:55:35.431676 28395 tablet_bootstrap.cc:654] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:35.431824 28222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a69e9c16e04008a145d51b5c038be8" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:35.432781 28440 leader_election.cc:290] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 election: Requested vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.434787 28336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a69e9c16e04008a145d51b5c038be8" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:35.434872 28337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19531b49699549f988681ad93f142486" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:35.434899 28225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:35.436136 28121 raft_consensus.cc:2468] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 1.
I20260807 07:55:35.437284 28222 raft_consensus.cc:3060] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.438614 28337 raft_consensus.cc:3060] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.439136 28225 raft_consensus.cc:2393] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c388fd85be3a4776aa66a26c350e91d9 in current term 1: Already voted for candidate 6a39421d9b3449bda922edd1aecff9ee in this term.
I20260807 07:55:35.441045 28173 leader_election.cc:304] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee; no voters:
I20260807 07:55:35.442376 28397 tablet_bootstrap.cc:492] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9: No bootstrap required, opened a new log
I20260807 07:55:35.442018 28442 raft_consensus.cc:2804] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:55:35.443092 28397 ts_tablet_manager.cc:1403] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9: Time spent bootstrapping tablet: real 0.153s user 0.014s sys 0.006s
I20260807 07:55:35.446139 28287 leader_election.cc:304] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c388fd85be3a4776aa66a26c350e91d9; no voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee
I20260807 07:55:35.447508 28407 raft_consensus.cc:2749] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260807 07:55:35.448053 28063 leader_election.cc:343] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.445798 28442 raft_consensus.cc:697] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Becoming Leader. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:35.449245 28442 consensus_queue.cc:237] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.450860 28337 raft_consensus.cc:2468] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 1.
I20260807 07:55:35.454005 28222 raft_consensus.cc:2468] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 1.
I20260807 07:55:35.455271 28062 leader_election.cc:304] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee; no voters: c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:35.456950 28440 raft_consensus.cc:2804] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:55:35.457492 28440 raft_consensus.cc:697] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 LEADER]: Becoming Leader. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Running, Role: LEADER
I20260807 07:55:35.458297 28440 consensus_queue.cc:237] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.463286 28397 raft_consensus.cc:359] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.466699 28443 raft_consensus.cc:493] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.467020 28397 raft_consensus.cc:385] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.467301 28397 raft_consensus.cc:740] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Initialized, Role: FOLLOWER
I20260807 07:55:35.467195 28443 raft_consensus.cc:515] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.467959 28397 consensus_queue.cc:260] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.471659 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e6d12080cd481e95ea126f9ba401f9" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.471828 28337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e6d12080cd481e95ea126f9ba401f9" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:35.472395 28337 raft_consensus.cc:2468] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 0.
W20260807 07:55:35.473222 28173 leader_election.cc:343] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.469296 28443 leader_election.cc:290] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.474190 28176 leader_election.cc:304] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters: 52333cbb1cf7443a959e5bb2f7f3069c
I20260807 07:55:35.475265 28443 raft_consensus.cc:2804] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:55:35.475986 28443 raft_consensus.cc:493] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:35.476432 28443 raft_consensus.cc:3060] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.475596 28397 ts_tablet_manager.cc:1434] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9: Time spent starting tablet: real 0.032s user 0.004s sys 0.001s
I20260807 07:55:35.478760 28397 tablet_bootstrap.cc:492] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9: Bootstrap starting.
I20260807 07:55:35.485003 28443 raft_consensus.cc:515] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.491835 27955 catalog_manager.cc:5697] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c reported cstate change: term changed from 0 to 1, leader changed from <none> to 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129). New cstate: current_term: 1 leader_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:35.493342 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e6d12080cd481e95ea126f9ba401f9" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
W20260807 07:55:35.494755 28173 leader_election.cc:343] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:55:35.497032 28337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e6d12080cd481e95ea126f9ba401f9" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:35.497911 28337 raft_consensus.cc:3060] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.500775 28443 leader_election.cc:290] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.502925 28394 tablet_bootstrap.cc:492] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee: No bootstrap required, opened a new log
I20260807 07:55:35.503422 28394 ts_tablet_manager.cc:1403] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee: Time spent bootstrapping tablet: real 0.105s user 0.016s sys 0.002s
I20260807 07:55:35.504045 28397 tablet_bootstrap.cc:654] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:35.505712 28337 raft_consensus.cc:2468] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 1.
I20260807 07:55:35.506004 28394 raft_consensus.cc:359] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.506742 28394 raft_consensus.cc:385] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.507064 28394 raft_consensus.cc:740] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Initialized, Role: FOLLOWER
I20260807 07:55:35.508402 28176 leader_election.cc:304] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters: 52333cbb1cf7443a959e5bb2f7f3069c
I20260807 07:55:35.509490 28394 consensus_queue.cc:260] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.509932 28443 raft_consensus.cc:2804] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:55:35.509569 27958 catalog_manager.cc:5697] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130). New cstate: current_term: 1 leader_uuid: "6a39421d9b3449bda922edd1aecff9ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:35.510692 28443 raft_consensus.cc:697] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Becoming Leader. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:35.508852 28395 tablet_bootstrap.cc:492] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c: No bootstrap required, opened a new log
I20260807 07:55:35.511729 28395 ts_tablet_manager.cc:1403] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent bootstrapping tablet: real 0.132s user 0.021s sys 0.019s
I20260807 07:55:35.511538 28443 consensus_queue.cc:237] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.515782 28395 raft_consensus.cc:359] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.516515 28395 raft_consensus.cc:385] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.516851 28395 raft_consensus.cc:740] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Initialized, Role: FOLLOWER
I20260807 07:55:35.512806 28394 ts_tablet_manager.cc:1434] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260807 07:55:35.518115 28394 tablet_bootstrap.cc:492] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee: Bootstrap starting.
I20260807 07:55:35.524000 28394 tablet_bootstrap.cc:654] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:35.526975 28397 tablet_bootstrap.cc:492] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9: No bootstrap required, opened a new log
I20260807 07:55:35.524747 28395 consensus_queue.cc:260] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.527416 28397 ts_tablet_manager.cc:1403] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9: Time spent bootstrapping tablet: real 0.049s user 0.011s sys 0.004s
I20260807 07:55:35.529673 28395 ts_tablet_manager.cc:1434] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20260807 07:55:35.530696 28395 tablet_bootstrap.cc:492] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c: Bootstrap starting.
I20260807 07:55:35.533274 28397 raft_consensus.cc:359] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.533977 28397 raft_consensus.cc:385] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.534240 28397 raft_consensus.cc:740] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Initialized, Role: FOLLOWER
I20260807 07:55:35.535072 28397 consensus_queue.cc:260] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.537910 28395 tablet_bootstrap.cc:654] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:35.545125 28394 tablet_bootstrap.cc:492] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee: No bootstrap required, opened a new log
I20260807 07:55:35.545578 28394 ts_tablet_manager.cc:1403] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee: Time spent bootstrapping tablet: real 0.028s user 0.008s sys 0.005s
I20260807 07:55:35.544907 27955 catalog_manager.cc:5697] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130). New cstate: current_term: 1 leader_uuid: "6a39421d9b3449bda922edd1aecff9ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:35.548120 28394 raft_consensus.cc:359] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.548751 28394 raft_consensus.cc:385] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.549012 28394 raft_consensus.cc:740] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Initialized, Role: FOLLOWER
I20260807 07:55:35.550127 28397 ts_tablet_manager.cc:1434] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260807 07:55:35.550794 28394 consensus_queue.cc:260] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.552595 28394 ts_tablet_manager.cc:1434] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260807 07:55:35.556984 28395 tablet_bootstrap.cc:492] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c: No bootstrap required, opened a new log
I20260807 07:55:35.557464 28395 ts_tablet_manager.cc:1403] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent bootstrapping tablet: real 0.027s user 0.013s sys 0.000s
I20260807 07:55:35.559877 28395 raft_consensus.cc:359] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.560556 28395 raft_consensus.cc:385] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.560845 28395 raft_consensus.cc:740] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Initialized, Role: FOLLOWER
I20260807 07:55:35.561646 28395 consensus_queue.cc:260] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.564203 28395 ts_tablet_manager.cc:1434] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 07:55:35.565160 28395 tablet_bootstrap.cc:492] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c: Bootstrap starting.
I20260807 07:55:35.570082 28395 tablet_bootstrap.cc:654] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:35.575743 28395 tablet_bootstrap.cc:492] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c: No bootstrap required, opened a new log
I20260807 07:55:35.576086 28395 ts_tablet_manager.cc:1403] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.001s
I20260807 07:55:35.577907 28395 raft_consensus.cc:359] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.578336 28395 raft_consensus.cc:385] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.578536 28395 raft_consensus.cc:740] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Initialized, Role: FOLLOWER
I20260807 07:55:35.579053 28395 consensus_queue.cc:260] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.580440 28395 ts_tablet_manager.cc:1434] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260807 07:55:35.581429 28395 tablet_bootstrap.cc:492] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c: Bootstrap starting.
I20260807 07:55:35.586052 28395 tablet_bootstrap.cc:654] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c: Neither blocks nor log segments found. Creating new log.
I20260807 07:55:35.592384 28395 tablet_bootstrap.cc:492] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c: No bootstrap required, opened a new log
I20260807 07:55:35.592840 28395 ts_tablet_manager.cc:1403] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260807 07:55:35.593132 28443 raft_consensus.cc:493] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.593626 28443 raft_consensus.cc:515] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.595319 28395 raft_consensus.cc:359] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.595659 28443 leader_election.cc:290] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.595973 28395 raft_consensus.cc:385] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:55:35.596241 28395 raft_consensus.cc:740] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Initialized, Role: FOLLOWER
I20260807 07:55:35.597150 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61ff273d6be468982ab05bb74f43355" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.596931 28395 consensus_queue.cc:260] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.597628 28337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61ff273d6be468982ab05bb74f43355" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:35.597779 28121 raft_consensus.cc:2468] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 0.
I20260807 07:55:35.598238 28337 raft_consensus.cc:2468] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 0.
I20260807 07:55:35.598920 28395 ts_tablet_manager.cc:1434] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 07:55:35.599501 28176 leader_election.cc:304] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:35.600250 28443 raft_consensus.cc:2804] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:55:35.600595 28443 raft_consensus.cc:493] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:35.600922 28443 raft_consensus.cc:3060] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.607626 28443 raft_consensus.cc:515] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.609652 28443 leader_election.cc:290] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.610831 28337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61ff273d6be468982ab05bb74f43355" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:35.611414 28337 raft_consensus.cc:3060] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.611285 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61ff273d6be468982ab05bb74f43355" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:35.612437 28121 raft_consensus.cc:3060] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.618709 28337 raft_consensus.cc:2468] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 1.
W20260807 07:55:35.619452 28033 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:55:35.619866 28176 leader_election.cc:304] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:35.620360 28121 raft_consensus.cc:2468] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 1.
I20260807 07:55:35.620529 28443 raft_consensus.cc:2804] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:55:35.620987 28443 raft_consensus.cc:697] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Becoming Leader. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:35.621817 28443 consensus_queue.cc:237] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.628727 27955 catalog_manager.cc:5697] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130). New cstate: current_term: 1 leader_uuid: "6a39421d9b3449bda922edd1aecff9ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:35.751467 28407 consensus_queue.cc:1048] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:35.777432 28484 consensus_queue.cc:1048] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:55:35.795303 28440 raft_consensus.cc:493] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.795818 28440 raft_consensus.cc:515] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.797880 28440 leader_election.cc:290] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.799110 28222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e6d12080cd481e95ea126f9ba401f9" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee" is_pre_election: true
I20260807 07:55:35.799110 28337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e6d12080cd481e95ea126f9ba401f9" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:35.800114 28337 raft_consensus.cc:2393] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 52333cbb1cf7443a959e5bb2f7f3069c in current term 1: Already voted for candidate 6a39421d9b3449bda922edd1aecff9ee in this term.
I20260807 07:55:35.801440 28062 leader_election.cc:304] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c; no voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:35.802248 28440 raft_consensus.cc:3060] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.807624 28440 raft_consensus.cc:2749] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:55:35.810643 28443 raft_consensus.cc:493] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.811159 28443 raft_consensus.cc:515] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.813297 28443 leader_election.cc:290] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.816461 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8349b1da04e043bc856961aee4297ea8" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.817777 28337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8349b1da04e043bc856961aee4297ea8" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:35.818460 28337 raft_consensus.cc:2468] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 0.
I20260807 07:55:35.819994 28176 leader_election.cc:304] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:35.817170 28121 raft_consensus.cc:2468] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 0.
I20260807 07:55:35.820817 28443 raft_consensus.cc:2804] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:55:35.821202 28443 raft_consensus.cc:493] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:35.821573 28443 raft_consensus.cc:3060] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.827979 28443 raft_consensus.cc:515] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.830052 28443 leader_election.cc:290] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:35.831648 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8349b1da04e043bc856961aee4297ea8" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:35.831708 28337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8349b1da04e043bc856961aee4297ea8" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:35.832296 28121 raft_consensus.cc:3060] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.832542 28337 raft_consensus.cc:3060] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.837083 28337 raft_consensus.cc:2468] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 1.
I20260807 07:55:35.838068 28176 leader_election.cc:304] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:35.838572 28121 raft_consensus.cc:2468] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 1.
I20260807 07:55:35.838769 28443 raft_consensus.cc:2804] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:55:35.839222 28443 raft_consensus.cc:697] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Becoming Leader. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:35.840190 28443 consensus_queue.cc:237] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.847414 27955 catalog_manager.cc:5697] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130). New cstate: current_term: 1 leader_uuid: "6a39421d9b3449bda922edd1aecff9ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:35.888334 28484 raft_consensus.cc:493] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:35.888859 28484 raft_consensus.cc:515] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:35.890784 28484 leader_election.cc:290] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:35.891988 28225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a69e9c16e04008a145d51b5c038be8" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee" is_pre_election: true
I20260807 07:55:35.892478 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a69e9c16e04008a145d51b5c038be8" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:35.892776 28225 raft_consensus.cc:2393] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c388fd85be3a4776aa66a26c350e91d9 in current term 1: Already voted for candidate 52333cbb1cf7443a959e5bb2f7f3069c in this term.
I20260807 07:55:35.892452 28440 consensus_queue.cc:1048] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:35.894292 28287 leader_election.cc:304] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c388fd85be3a4776aa66a26c350e91d9; no voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee
I20260807 07:55:35.895378 28484 raft_consensus.cc:3060] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:35.899770 28447 consensus_queue.cc:1048] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:35.901347 28440 consensus_queue.cc:1048] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:35.916013 28447 consensus_queue.cc:1048] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:35.931116 28484 raft_consensus.cc:2749] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:55:35.961026 28443 consensus_queue.cc:1048] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:35.973452 28404 consensus_queue.cc:1048] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:36.022722 28440 raft_consensus.cc:493] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:36.023332 28440 raft_consensus.cc:515] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:36.025602 28440 leader_election.cc:290] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:36.026733 28222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee" is_pre_election: true
I20260807 07:55:36.027531 28222 raft_consensus.cc:2393] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 52333cbb1cf7443a959e5bb2f7f3069c in current term 1: Already voted for candidate 6a39421d9b3449bda922edd1aecff9ee in this term.
I20260807 07:55:36.026880 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:36.028344 28335 raft_consensus.cc:2393] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 52333cbb1cf7443a959e5bb2f7f3069c in current term 1: Already voted for candidate c388fd85be3a4776aa66a26c350e91d9 in this term.
I20260807 07:55:36.029531 28404 consensus_queue.cc:1048] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:36.029588 28063 leader_election.cc:304] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c; no voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:36.030418 28440 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:55:36.037345 28440 raft_consensus.cc:2749] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:55:36.043912 28443 consensus_queue.cc:1048] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:55:36.052419 28440 consensus_queue.cc:1048] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:36.066009 28408 consensus_queue.cc:1048] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:36.247435 28443 consensus_queue.cc:1048] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:36.260126 28443 consensus_queue.cc:1048] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 07:55:36.622581 28033 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:55:36.836444 28440 raft_consensus.cc:493] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:36.836941 28440 raft_consensus.cc:515] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:36.838588 28440 leader_election.cc:290] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:36.839496 28222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee" is_pre_election: true
I20260807 07:55:36.839643 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:36.840000 28222 raft_consensus.cc:2468] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 1.
I20260807 07:55:36.840212 28335 raft_consensus.cc:2468] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 1.
I20260807 07:55:36.841112 28062 leader_election.cc:304] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee; no voters:
I20260807 07:55:36.841814 28440 raft_consensus.cc:2804] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:55:36.842073 28440 raft_consensus.cc:493] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:36.842319 28440 raft_consensus.cc:3060] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:36.846827 28440 raft_consensus.cc:515] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:36.848274 28440 leader_election.cc:290] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 2 election: Requested vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:36.849042 28222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:36.849222 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:36.849485 28222 raft_consensus.cc:3060] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:36.849723 28335 raft_consensus.cc:3060] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:36.854096 28335 raft_consensus.cc:2468] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 2.
I20260807 07:55:36.854101 28222 raft_consensus.cc:2468] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 2.
I20260807 07:55:36.855372 28063 leader_election.cc:304] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:36.856406 28440 raft_consensus.cc:2804] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:55:36.856954 28440 raft_consensus.cc:697] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Becoming Leader. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Running, Role: LEADER
I20260807 07:55:36.857926 28440 consensus_queue.cc:237] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:36.865047 27957 catalog_manager.cc:5697] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c reported cstate change: term changed from 0 to 2, leader changed from <none> to 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129). New cstate: current_term: 2 leader_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:37.366055 28222 raft_consensus.cc:1275] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Refusing update from remote peer 52333cbb1cf7443a959e5bb2f7f3069c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 07:55:37.367585 28440 consensus_queue.cc:1048] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:37.379036 28335 raft_consensus.cc:1275] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Refusing update from remote peer 52333cbb1cf7443a959e5bb2f7f3069c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 07:55:37.383391 28521 consensus_queue.cc:1048] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:37.444991 28443 raft_consensus.cc:493] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:55:37.445518 28443 raft_consensus.cc:515] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:37.447464 28443 leader_election.cc:290] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:37.448374 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" is_pre_election: true
I20260807 07:55:37.448783 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9" is_pre_election: true
I20260807 07:55:37.448995 28121 raft_consensus.cc:2468] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 1.
I20260807 07:55:37.449450 28335 raft_consensus.cc:2468] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 1.
I20260807 07:55:37.450206 28173 leader_election.cc:304] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee; no voters:
I20260807 07:55:37.450924 28443 raft_consensus.cc:2804] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:55:37.451303 28443 raft_consensus.cc:493] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:55:37.451653 28443 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:37.457108 28443 raft_consensus.cc:515] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:37.458730 28443 leader_election.cc:290] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 2 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:37.459542 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:37.459841 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:37.460143 28121 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:37.460404 28335 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:37.466852 28335 raft_consensus.cc:2468] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 2.
I20260807 07:55:37.466852 28121 raft_consensus.cc:2468] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 2.
I20260807 07:55:37.468209 28176 leader_election.cc:304] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:37.468883 28443 raft_consensus.cc:2804] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:55:37.469942 28443 raft_consensus.cc:697] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 2 LEADER]: Becoming Leader. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:37.470690 28443 consensus_queue.cc:237] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:37.478235 27958 catalog_manager.cc:5697] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee reported cstate change: term changed from 0 to 2, leader changed from <none> to 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130). New cstate: current_term: 2 leader_uuid: "6a39421d9b3449bda922edd1aecff9ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:37.849830 28336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00c2297df5ee409099f88f389a23e956"
dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
mode: GRACEFUL
new_leader_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
from {username='slave'} at 127.0.0.1:39206
I20260807 07:55:37.850415 28336 raft_consensus.cc:606] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 1 LEADER]: Received request to transfer leadership to TS 52333cbb1cf7443a959e5bb2f7f3069c
I20260807 07:55:37.867043 28222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
mode: GRACEFUL
new_leader_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
from {username='slave'} at 127.0.0.1:57218
I20260807 07:55:37.867544 28222 raft_consensus.cc:606] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 2 LEADER]: Received request to transfer leadership to TS 52333cbb1cf7443a959e5bb2f7f3069c
I20260807 07:55:37.882957 28121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4a69e9c16e04008a145d51b5c038be8"
dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
mode: GRACEFUL
new_leader_uuid: "6a39421d9b3449bda922edd1aecff9ee"
from {username='slave'} at 127.0.0.1:34838
I20260807 07:55:37.883448 28121 raft_consensus.cc:606] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 LEADER]: Received request to transfer leadership to TS 6a39421d9b3449bda922edd1aecff9ee
I20260807 07:55:37.892987 28222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8349b1da04e043bc856961aee4297ea8"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
mode: GRACEFUL
new_leader_uuid: "c388fd85be3a4776aa66a26c350e91d9"
from {username='slave'} at 127.0.0.1:57218
I20260807 07:55:37.893489 28222 raft_consensus.cc:606] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Received request to transfer leadership to TS c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:38.018296 28121 raft_consensus.cc:1275] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 07:55:38.019553 28443 consensus_queue.cc:1048] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:38.025539 28532 raft_consensus.cc:993] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee: : Instructing follower 52333cbb1cf7443a959e5bb2f7f3069c to start an election
I20260807 07:55:38.026175 28443 raft_consensus.cc:1081] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 2 LEADER]: Signalling peer 52333cbb1cf7443a959e5bb2f7f3069c to start an election
I20260807 07:55:38.028378 28122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57"
dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
from {username='slave'} at 127.0.0.1:34820
I20260807 07:55:38.029459 28122 raft_consensus.cc:493] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:38.029875 28122 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:55:38.033991 28336 raft_consensus.cc:1275] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260807 07:55:38.035696 28532 consensus_queue.cc:1048] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:55:38.036371 28122 raft_consensus.cc:515] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:38.039057 28222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:38.039661 28222 raft_consensus.cc:3055] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:55:38.040012 28122 leader_election.cc:290] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 3 election: Requested vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:38.039983 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:38.039961 28222 raft_consensus.cc:740] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:38.043517 28222 consensus_queue.cc:260] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:38.044653 28222 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:55:38.050499 28222 raft_consensus.cc:2468] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 3.
I20260807 07:55:38.051524 28062 leader_election.cc:304] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee; no voters: c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:38.052168 28546 raft_consensus.cc:2804] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:55:38.052591 28546 raft_consensus.cc:697] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 LEADER]: Becoming Leader. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Running, Role: LEADER
I20260807 07:55:38.053339 28546 consensus_queue.cc:237] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:38.060289 27957 catalog_manager.cc:5697] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c reported cstate change: term changed from 2 to 3, leader changed from 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130) to 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129). New cstate: current_term: 3 leader_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:38.195631 28552 raft_consensus.cc:993] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee: : Instructing follower c388fd85be3a4776aa66a26c350e91d9 to start an election
I20260807 07:55:38.196070 28532 raft_consensus.cc:1081] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Signalling peer c388fd85be3a4776aa66a26c350e91d9 to start an election
I20260807 07:55:38.197527 28336 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8349b1da04e043bc856961aee4297ea8"
dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
from {username='slave'} at 127.0.0.1:39184
I20260807 07:55:38.197992 28336 raft_consensus.cc:493] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:38.198279 28336 raft_consensus.cc:3060] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:38.202622 28336 raft_consensus.cc:515] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:38.204257 28336 leader_election.cc:290] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 2 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:38.205144 28122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8349b1da04e043bc856961aee4297ea8" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:38.205304 28222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8349b1da04e043bc856961aee4297ea8" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:38.205735 28122 raft_consensus.cc:3060] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:38.205838 28222 raft_consensus.cc:3055] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:55:38.206147 28222 raft_consensus.cc:740] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:38.206872 28222 consensus_queue.cc:260] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:38.207793 28222 raft_consensus.cc:3060] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:38.210592 28122 raft_consensus.cc:2468] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 2.
I20260807 07:55:38.211601 28284 leader_election.cc:304] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:38.212302 28509 raft_consensus.cc:2804] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:55:38.213539 28222 raft_consensus.cc:2468] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 2.
I20260807 07:55:38.213541 28509 raft_consensus.cc:697] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [term 2 LEADER]: Becoming Leader. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Running, Role: LEADER
I20260807 07:55:38.214449 28509 consensus_queue.cc:237] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:38.221558 27957 catalog_manager.cc:5697] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 reported cstate change: term changed from 1 to 2, leader changed from 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130) to c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131). New cstate: current_term: 2 leader_uuid: "c388fd85be3a4776aa66a26c350e91d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: HEALTHY } } }
I20260807 07:55:38.301331 28545 raft_consensus.cc:993] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c: : Instructing follower 6a39421d9b3449bda922edd1aecff9ee to start an election
I20260807 07:55:38.301852 28546 raft_consensus.cc:1081] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 LEADER]: Signalling peer 6a39421d9b3449bda922edd1aecff9ee to start an election
I20260807 07:55:38.303505 28222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4a69e9c16e04008a145d51b5c038be8"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
from {username='slave'} at 127.0.0.1:57196
I20260807 07:55:38.304075 28222 raft_consensus.cc:493] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:38.304360 28222 raft_consensus.cc:3060] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:38.309547 28222 raft_consensus.cc:515] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:38.309949 28558 raft_consensus.cc:993] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9: : Instructing follower 52333cbb1cf7443a959e5bb2f7f3069c to start an election
I20260807 07:55:38.310420 28509 raft_consensus.cc:1081] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 1 LEADER]: Signalling peer 52333cbb1cf7443a959e5bb2f7f3069c to start an election
I20260807 07:55:38.311862 28122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00c2297df5ee409099f88f389a23e956"
dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
from {username='slave'} at 127.0.0.1:34832
I20260807 07:55:38.311911 28222 leader_election.cc:290] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 2 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:38.312276 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a69e9c16e04008a145d51b5c038be8" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:38.312561 28122 raft_consensus.cc:493] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:38.312501 28336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a69e9c16e04008a145d51b5c038be8" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:38.313038 28121 raft_consensus.cc:3055] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:55:38.313042 28122 raft_consensus.cc:3060] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:38.313572 28336 raft_consensus.cc:3060] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:38.313565 28121 raft_consensus.cc:740] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Running, Role: LEADER
I20260807 07:55:38.314580 28121 consensus_queue.cc:260] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:38.315527 28121 raft_consensus.cc:3060] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:38.320039 28336 raft_consensus.cc:2468] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 2.
I20260807 07:55:38.320109 28121 raft_consensus.cc:2468] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 2.
I20260807 07:55:38.320082 28122 raft_consensus.cc:515] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:38.321445 28176 leader_election.cc:304] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:38.322321 28122 leader_election.cc:290] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 2 election: Requested vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:38.322610 28532 raft_consensus.cc:2804] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:55:38.323081 28532 raft_consensus.cc:697] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 2 LEADER]: Becoming Leader. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:38.323727 28336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c2297df5ee409099f88f389a23e956" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:38.323244 28222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c2297df5ee409099f88f389a23e956" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:38.323849 28532 consensus_queue.cc:237] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:38.324337 28336 raft_consensus.cc:3055] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:55:38.324463 28222 raft_consensus.cc:3060] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:38.324729 28336 raft_consensus.cc:740] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Running, Role: LEADER
I20260807 07:55:38.325608 28336 consensus_queue.cc:260] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:38.326836 28336 raft_consensus.cc:3060] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:38.331804 27957 catalog_manager.cc:5697] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee reported cstate change: term changed from 1 to 2, leader changed from 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129) to 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130). New cstate: current_term: 2 leader_uuid: "6a39421d9b3449bda922edd1aecff9ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:38.333750 28336 raft_consensus.cc:2468] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 2.
I20260807 07:55:38.333932 28222 raft_consensus.cc:2468] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 2.
I20260807 07:55:38.334985 28063 leader_election.cc:304] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:38.335635 28546 raft_consensus.cc:2804] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:55:38.336087 28546 raft_consensus.cc:697] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Becoming Leader. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Running, Role: LEADER
I20260807 07:55:38.336810 28546 consensus_queue.cc:237] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:38.343991 27957 catalog_manager.cc:5697] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c reported cstate change: term changed from 1 to 2, leader changed from c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131) to 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129). New cstate: current_term: 2 leader_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:38.461923 28222 raft_consensus.cc:1275] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 3 FOLLOWER]: Refusing update from remote peer 52333cbb1cf7443a959e5bb2f7f3069c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:55:38.463133 28546 consensus_queue.cc:1048] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:38.470371 28336 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:55:38.476959 28336 raft_consensus.cc:1275] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Refusing update from remote peer 52333cbb1cf7443a959e5bb2f7f3069c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:55:38.478418 28546 consensus_queue.cc:1048] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:38.612725 28122 raft_consensus.cc:1275] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Refusing update from remote peer c388fd85be3a4776aa66a26c350e91d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:38.613972 28509 consensus_queue.cc:1048] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:38.622175 28222 raft_consensus.cc:1275] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Refusing update from remote peer c388fd85be3a4776aa66a26c350e91d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:38.623870 28565 consensus_queue.cc:1048] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:38.796228 28222 raft_consensus.cc:1275] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Refusing update from remote peer 52333cbb1cf7443a959e5bb2f7f3069c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:38.797401 28546 consensus_queue.cc:1048] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:38.805018 28336 raft_consensus.cc:1275] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Refusing update from remote peer 52333cbb1cf7443a959e5bb2f7f3069c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:38.806376 28545 consensus_queue.cc:1048] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:38.852011 28122 raft_consensus.cc:1275] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:38.853271 28532 consensus_queue.cc:1048] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:38.864763 28336 raft_consensus.cc:1275] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:38.866048 28572 consensus_queue.cc:1048] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:40.922648 27906 auto_leader_rebalancer-test.cc:402] The leader distribution is
I20260807 07:55:40.923451 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:40.942306 28222 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19531b49699549f988681ad93f142486"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
mode: GRACEFUL
new_leader_uuid: "c388fd85be3a4776aa66a26c350e91d9"
from {username='slave'} at 127.0.0.1:57224
I20260807 07:55:40.942802 28222 raft_consensus.cc:606] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Received request to transfer leadership to TS c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:40.953341 28122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57"
dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
mode: GRACEFUL
new_leader_uuid: "c388fd85be3a4776aa66a26c350e91d9"
from {username='slave'} at 127.0.0.1:34844
I20260807 07:55:40.953987 28122 raft_consensus.cc:606] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 LEADER]: Received request to transfer leadership to TS c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:40.955230 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 07:55:40.955642 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:41.179982 28581 raft_consensus.cc:993] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c: : Instructing follower c388fd85be3a4776aa66a26c350e91d9 to start an election
I20260807 07:55:41.180409 28585 raft_consensus.cc:1081] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 LEADER]: Signalling peer c388fd85be3a4776aa66a26c350e91d9 to start an election
I20260807 07:55:41.181926 28335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57"
dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
from {username='slave'} at 127.0.0.1:39196
I20260807 07:55:41.182355 28335 raft_consensus.cc:493] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:41.182608 28335 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:55:41.186964 28335 raft_consensus.cc:515] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:41.188740 28335 leader_election.cc:290] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 4 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:41.189507 28122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:41.189879 28222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:41.190120 28122 raft_consensus.cc:3055] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:55:41.190447 28222 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:55:41.190443 28122 raft_consensus.cc:740] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Running, Role: LEADER
I20260807 07:55:41.191365 28122 consensus_queue.cc:260] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:41.192551 28122 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:55:41.196808 28222 raft_consensus.cc:2468] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 4.
I20260807 07:55:41.197999 28287 leader_election.cc:304] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:41.198447 28122 raft_consensus.cc:2468] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 4.
I20260807 07:55:41.198666 28565 raft_consensus.cc:2804] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:55:41.199988 28565 raft_consensus.cc:697] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 4 LEADER]: Becoming Leader. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Running, Role: LEADER
I20260807 07:55:41.200714 28565 consensus_queue.cc:237] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:41.207937 27957 catalog_manager.cc:5697] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 reported cstate change: term changed from 3 to 4, leader changed from 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129) to c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131). New cstate: current_term: 4 leader_uuid: "c388fd85be3a4776aa66a26c350e91d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: HEALTHY } } }
I20260807 07:55:41.261950 28601 raft_consensus.cc:993] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee: : Instructing follower c388fd85be3a4776aa66a26c350e91d9 to start an election
I20260807 07:55:41.262404 28573 raft_consensus.cc:1081] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Signalling peer c388fd85be3a4776aa66a26c350e91d9 to start an election
I20260807 07:55:41.263854 28335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19531b49699549f988681ad93f142486"
dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
from {username='slave'} at 127.0.0.1:39184
I20260807 07:55:41.264345 28335 raft_consensus.cc:493] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:41.264686 28335 raft_consensus.cc:3060] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:41.269187 28335 raft_consensus.cc:515] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:41.270900 28335 leader_election.cc:290] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 2 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:41.271652 28122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19531b49699549f988681ad93f142486" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:41.272459 28222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19531b49699549f988681ad93f142486" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:41.272775 28122 raft_consensus.cc:3060] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:41.273146 28222 raft_consensus.cc:3055] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:55:41.273484 28222 raft_consensus.cc:740] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:41.274113 28222 consensus_queue.cc:260] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:41.274897 28222 raft_consensus.cc:3060] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:41.277532 28122 raft_consensus.cc:2468] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 2.
I20260807 07:55:41.278601 28222 raft_consensus.cc:2468] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 2.
I20260807 07:55:41.278569 28284 leader_election.cc:304] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:41.279479 28565 raft_consensus.cc:2804] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:55:41.279928 28565 raft_consensus.cc:697] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 2 LEADER]: Becoming Leader. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Running, Role: LEADER
I20260807 07:55:41.280654 28565 consensus_queue.cc:237] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:41.286861 27957 catalog_manager.cc:5697] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 reported cstate change: term changed from 1 to 2, leader changed from 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130) to c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131). New cstate: current_term: 2 leader_uuid: "c388fd85be3a4776aa66a26c350e91d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: HEALTHY } } }
I20260807 07:55:41.670040 28122 raft_consensus.cc:1275] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 4 FOLLOWER]: Refusing update from remote peer c388fd85be3a4776aa66a26c350e91d9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:55:41.671473 28565 consensus_queue.cc:1048] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:55:41.676604 28121 raft_consensus.cc:1275] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Refusing update from remote peer c388fd85be3a4776aa66a26c350e91d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:41.677942 28565 consensus_queue.cc:1048] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:41.687858 28222 raft_consensus.cc:1275] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 4 FOLLOWER]: Refusing update from remote peer c388fd85be3a4776aa66a26c350e91d9: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:55:41.692128 28587 consensus_queue.cc:1048] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:55:41.697530 28225 raft_consensus.cc:1275] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Refusing update from remote peer c388fd85be3a4776aa66a26c350e91d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:41.699209 28587 consensus_queue.cc:1048] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:41.956525 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:41.961267 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:41.961709 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:42.962857 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:42.967927 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:42.968341 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:43.969338 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:43.973979 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:43.974478 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:44.975436 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:44.980572 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:44.981032 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:45.981971 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:45.986701 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:45.987141 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:46.988068 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:46.993932 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:46.994347 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:47.995242 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:47.999954 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:48.000368 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:49.001196 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:49.005980 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:49.006376 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:50.007266 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:50.012296 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:50.012830 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:51.039471 27906 auto_leader_rebalancer-test.cc:421] The leader distribution is
I20260807 07:55:51.044468 28121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00c2297df5ee409099f88f389a23e956"
dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
mode: GRACEFUL
new_leader_uuid: "6a39421d9b3449bda922edd1aecff9ee"
from {username='slave'} at 127.0.0.1:34838
I20260807 07:55:51.045089 28121 raft_consensus.cc:606] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Received request to transfer leadership to TS 6a39421d9b3449bda922edd1aecff9ee
I20260807 07:55:51.049027 28623 raft_consensus.cc:993] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c: : Instructing follower 6a39421d9b3449bda922edd1aecff9ee to start an election
I20260807 07:55:51.049572 28626 raft_consensus.cc:1081] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Signalling peer 6a39421d9b3449bda922edd1aecff9ee to start an election
I20260807 07:55:51.050329 28121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e9566c0c8cb4919bf24d678583f9eed"
dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
mode: GRACEFUL
new_leader_uuid: "6a39421d9b3449bda922edd1aecff9ee"
from {username='slave'} at 127.0.0.1:34838
I20260807 07:55:51.050904 28121 raft_consensus.cc:606] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 LEADER]: Received request to transfer leadership to TS 6a39421d9b3449bda922edd1aecff9ee
I20260807 07:55:51.051147 28225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00c2297df5ee409099f88f389a23e956"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
from {username='slave'} at 127.0.0.1:57196
I20260807 07:55:51.051707 28225 raft_consensus.cc:493] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:51.052083 28225 raft_consensus.cc:3060] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:55:51.055560 28121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b"
dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
mode: GRACEFUL
new_leader_uuid: "6a39421d9b3449bda922edd1aecff9ee"
from {username='slave'} at 127.0.0.1:34838
I20260807 07:55:51.056007 28121 raft_consensus.cc:606] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Received request to transfer leadership to TS 6a39421d9b3449bda922edd1aecff9ee
I20260807 07:55:51.057663 28225 raft_consensus.cc:515] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.060235 28225 leader_election.cc:290] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 3 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:51.061034 28336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57"
dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
mode: GRACEFUL
new_leader_uuid: "6a39421d9b3449bda922edd1aecff9ee"
from {username='slave'} at 127.0.0.1:39206
I20260807 07:55:51.060981 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c2297df5ee409099f88f389a23e956" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:51.061502 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c2297df5ee409099f88f389a23e956" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:51.061734 28336 raft_consensus.cc:606] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 4 LEADER]: Received request to transfer leadership to TS 6a39421d9b3449bda922edd1aecff9ee
I20260807 07:55:51.061856 28121 raft_consensus.cc:3055] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:55:51.062188 28121 raft_consensus.cc:740] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Running, Role: LEADER
I20260807 07:55:51.062366 28335 raft_consensus.cc:3060] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:55:51.063055 28121 consensus_queue.cc:260] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.064220 28121 raft_consensus.cc:3060] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:55:51.068256 28335 raft_consensus.cc:2468] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 3.
I20260807 07:55:51.068187 28336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19531b49699549f988681ad93f142486"
dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
mode: GRACEFUL
new_leader_uuid: "6a39421d9b3449bda922edd1aecff9ee"
from {username='slave'} at 127.0.0.1:39206
I20260807 07:55:51.068813 28336 raft_consensus.cc:606] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 2 LEADER]: Received request to transfer leadership to TS 6a39421d9b3449bda922edd1aecff9ee
I20260807 07:55:51.070307 28121 raft_consensus.cc:2468] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 3.
I20260807 07:55:51.070438 28176 leader_election.cc:304] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:51.071477 28573 raft_consensus.cc:2804] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:55:51.072500 28573 raft_consensus.cc:697] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 3 LEADER]: Becoming Leader. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:51.073256 28573 consensus_queue.cc:237] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.080332 27957 catalog_manager.cc:5697] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee reported cstate change: term changed from 2 to 3, leader changed from 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129) to 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130). New cstate: current_term: 3 leader_uuid: "6a39421d9b3449bda922edd1aecff9ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:51.170354 28625 raft_consensus.cc:993] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9: : Instructing follower 6a39421d9b3449bda922edd1aecff9ee to start an election
I20260807 07:55:51.170928 28636 raft_consensus.cc:1081] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 4 LEADER]: Signalling peer 6a39421d9b3449bda922edd1aecff9ee to start an election
I20260807 07:55:51.172276 28225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
from {username='slave'} at 127.0.0.1:57206
I20260807 07:55:51.172714 28225 raft_consensus.cc:493] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:51.172991 28225 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:55:51.177990 28225 raft_consensus.cc:515] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.179570 28225 leader_election.cc:290] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 5 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:51.180310 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:51.180599 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:51.180886 28121 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:55:51.181118 28335 raft_consensus.cc:3055] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:55:51.181438 28335 raft_consensus.cc:740] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Running, Role: LEADER
I20260807 07:55:51.182171 28335 consensus_queue.cc:260] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.183055 28335 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:55:51.185249 28121 raft_consensus.cc:2468] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 5.
I20260807 07:55:51.186435 28173 leader_election.cc:304] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee; no voters:
I20260807 07:55:51.187247 28573 raft_consensus.cc:2804] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:55:51.187604 28335 raft_consensus.cc:2468] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 5.
I20260807 07:55:51.187639 28573 raft_consensus.cc:697] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 5 LEADER]: Becoming Leader. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:51.188823 28573 consensus_queue.cc:237] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.194418 28623 raft_consensus.cc:993] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c: : Instructing follower 6a39421d9b3449bda922edd1aecff9ee to start an election
I20260807 07:55:51.194859 28626 raft_consensus.cc:1081] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Signalling peer 6a39421d9b3449bda922edd1aecff9ee to start an election
I20260807 07:55:51.195974 27957 catalog_manager.cc:5697] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee reported cstate change: term changed from 4 to 5, leader changed from c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131) to 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130). New cstate: current_term: 5 leader_uuid: "6a39421d9b3449bda922edd1aecff9ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:51.196400 28225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
from {username='slave'} at 127.0.0.1:57196
I20260807 07:55:51.197086 28225 raft_consensus.cc:493] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:51.197484 28225 raft_consensus.cc:3060] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:55:51.202950 28225 raft_consensus.cc:515] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.204761 28225 leader_election.cc:290] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 3 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:51.205475 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:51.205807 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ca541804d2a4d4884620e683ea84d9b" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:51.206018 28121 raft_consensus.cc:3055] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:55:51.206305 28335 raft_consensus.cc:3060] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:55:51.206322 28121 raft_consensus.cc:740] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Running, Role: LEADER
I20260807 07:55:51.207221 28121 consensus_queue.cc:260] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.208312 28121 raft_consensus.cc:3060] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:55:51.212436 28335 raft_consensus.cc:2468] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 3.
I20260807 07:55:51.213572 28176 leader_election.cc:304] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:51.213924 28121 raft_consensus.cc:2468] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 3.
I20260807 07:55:51.214195 28573 raft_consensus.cc:2804] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:55:51.214641 28573 raft_consensus.cc:697] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 3 LEADER]: Becoming Leader. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:51.215667 28573 consensus_queue.cc:237] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.221957 27957 catalog_manager.cc:5697] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee reported cstate change: term changed from 2 to 3, leader changed from 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129) to 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130). New cstate: current_term: 3 leader_uuid: "6a39421d9b3449bda922edd1aecff9ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:51.233721 28625 raft_consensus.cc:993] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9: : Instructing follower 6a39421d9b3449bda922edd1aecff9ee to start an election
I20260807 07:55:51.234161 28625 raft_consensus.cc:1081] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 2 LEADER]: Signalling peer 6a39421d9b3449bda922edd1aecff9ee to start an election
I20260807 07:55:51.235478 28225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19531b49699549f988681ad93f142486"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
from {username='slave'} at 127.0.0.1:57206
I20260807 07:55:51.235919 28225 raft_consensus.cc:493] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:51.236191 28225 raft_consensus.cc:3060] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:55:51.241483 28225 raft_consensus.cc:515] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.242954 28225 leader_election.cc:290] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 3 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:51.243950 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19531b49699549f988681ad93f142486" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:51.244019 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19531b49699549f988681ad93f142486" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:51.244367 28335 raft_consensus.cc:3055] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:55:51.244500 28121 raft_consensus.cc:3060] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:55:51.244632 28335 raft_consensus.cc:740] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Running, Role: LEADER
I20260807 07:55:51.245242 28335 consensus_queue.cc:260] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.246070 28335 raft_consensus.cc:3060] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:55:51.248575 28121 raft_consensus.cc:2468] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 3.
I20260807 07:55:51.249468 28173 leader_election.cc:304] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, 6a39421d9b3449bda922edd1aecff9ee; no voters:
I20260807 07:55:51.250031 28335 raft_consensus.cc:2468] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 3.
I20260807 07:55:51.250128 28573 raft_consensus.cc:2804] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:55:51.250623 28573 raft_consensus.cc:697] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 3 LEADER]: Becoming Leader. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:51.251461 28573 consensus_queue.cc:237] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.257764 27957 catalog_manager.cc:5697] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee reported cstate change: term changed from 2 to 3, leader changed from c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131) to 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130). New cstate: current_term: 3 leader_uuid: "6a39421d9b3449bda922edd1aecff9ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:51.421501 28623 raft_consensus.cc:993] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c: : Instructing follower 6a39421d9b3449bda922edd1aecff9ee to start an election
I20260807 07:55:51.421963 28626 raft_consensus.cc:1081] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 LEADER]: Signalling peer 6a39421d9b3449bda922edd1aecff9ee to start an election
I20260807 07:55:51.423393 28225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e9566c0c8cb4919bf24d678583f9eed"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
from {username='slave'} at 127.0.0.1:57196
I20260807 07:55:51.423843 28225 raft_consensus.cc:493] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:51.424117 28225 raft_consensus.cc:3060] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:51.428644 28225 raft_consensus.cc:515] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.430203 28225 leader_election.cc:290] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 2 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:51.431031 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9566c0c8cb4919bf24d678583f9eed" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:51.431162 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9566c0c8cb4919bf24d678583f9eed" candidate_uuid: "6a39421d9b3449bda922edd1aecff9ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:51.431634 28121 raft_consensus.cc:3055] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:55:51.431674 28335 raft_consensus.cc:3060] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:51.432072 28121 raft_consensus.cc:740] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Running, Role: LEADER
I20260807 07:55:51.432816 28121 consensus_queue.cc:260] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.433930 28121 raft_consensus.cc:3060] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:51.437754 28335 raft_consensus.cc:2468] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 2.
I20260807 07:55:51.438808 28176 leader_election.cc:304] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a39421d9b3449bda922edd1aecff9ee, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:51.439285 28121 raft_consensus.cc:2468] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a39421d9b3449bda922edd1aecff9ee in term 2.
I20260807 07:55:51.439411 28573 raft_consensus.cc:2804] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:55:51.439826 28573 raft_consensus.cc:697] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 2 LEADER]: Becoming Leader. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:51.440501 28573 consensus_queue.cc:237] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:51.446738 27957 catalog_manager.cc:5697] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee reported cstate change: term changed from 1 to 2, leader changed from 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129) to 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130). New cstate: current_term: 2 leader_uuid: "6a39421d9b3449bda922edd1aecff9ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:51.516213 28121 raft_consensus.cc:1275] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:55:51.517308 28573 consensus_queue.cc:1048] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:55:51.528115 28335 raft_consensus.cc:1275] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:55:51.530165 28573 consensus_queue.cc:1048] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:55:51.691217 28335 raft_consensus.cc:1275] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 5 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:55:51.692437 28573 consensus_queue.cc:1048] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:55:51.704018 28121 raft_consensus.cc:1275] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 5 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:55:51.705283 28653 consensus_queue.cc:1048] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:55:51.741952 28121 raft_consensus.cc:1275] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:55:51.743077 28653 consensus_queue.cc:1048] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:55:51.751245 28336 raft_consensus.cc:1275] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:55:51.752668 28573 consensus_queue.cc:1048] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:55:51.804212 28121 raft_consensus.cc:1275] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:55:51.805346 28653 consensus_queue.cc:1048] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:51.807483 28336 raft_consensus.cc:1275] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:55:51.808611 28573 consensus_queue.cc:1048] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:51.855947 28336 raft_consensus.cc:1275] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:51.857105 28664 consensus_queue.cc:1048] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:51.865700 28121 raft_consensus.cc:1275] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Refusing update from remote peer 6a39421d9b3449bda922edd1aecff9ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:51.867172 28653 consensus_queue.cc:1048] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:54.108038 27906 auto_leader_rebalancer-test.cc:436] The leader distribution is
I20260807 07:55:54.108814 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:54.116003 28225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00c2297df5ee409099f88f389a23e956"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
mode: GRACEFUL
new_leader_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
from {username='slave'} at 127.0.0.1:57224
I20260807 07:55:54.116652 28225 raft_consensus.cc:606] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 3 LEADER]: Received request to transfer leadership to TS 52333cbb1cf7443a959e5bb2f7f3069c
I20260807 07:55:54.119316 28225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19531b49699549f988681ad93f142486"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
mode: GRACEFUL
new_leader_uuid: "c388fd85be3a4776aa66a26c350e91d9"
from {username='slave'} at 127.0.0.1:57224
I20260807 07:55:54.119771 28225 raft_consensus.cc:606] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 3 LEADER]: Received request to transfer leadership to TS c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:54.122159 28225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4e6d12080cd481e95ea126f9ba401f9"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
mode: GRACEFUL
new_leader_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
from {username='slave'} at 127.0.0.1:57224
I20260807 07:55:54.122620 28225 raft_consensus.cc:606] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Received request to transfer leadership to TS 52333cbb1cf7443a959e5bb2f7f3069c
I20260807 07:55:54.124728 28225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c61ff273d6be468982ab05bb74f43355"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
mode: GRACEFUL
new_leader_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
from {username='slave'} at 127.0.0.1:57224
I20260807 07:55:54.125172 28225 raft_consensus.cc:606] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Received request to transfer leadership to TS 52333cbb1cf7443a959e5bb2f7f3069c
I20260807 07:55:54.127357 28225 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57"
dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
mode: GRACEFUL
new_leader_uuid: "c388fd85be3a4776aa66a26c350e91d9"
from {username='slave'} at 127.0.0.1:57224
I20260807 07:55:54.127785 28225 raft_consensus.cc:606] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 5 LEADER]: Received request to transfer leadership to TS c388fd85be3a4776aa66a26c350e91d9
I20260807 07:55:54.128839 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 07:55:54.129454 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:54.131227 28627 raft_consensus.cc:993] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee: : Instructing follower 52333cbb1cf7443a959e5bb2f7f3069c to start an election
I20260807 07:55:54.131705 28670 raft_consensus.cc:1081] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 3 LEADER]: Signalling peer 52333cbb1cf7443a959e5bb2f7f3069c to start an election
I20260807 07:55:54.133095 28121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00c2297df5ee409099f88f389a23e956"
dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
from {username='slave'} at 127.0.0.1:34820
I20260807 07:55:54.133598 28121 raft_consensus.cc:493] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:54.133876 28121 raft_consensus.cc:3060] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:55:54.138666 28121 raft_consensus.cc:515] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.140601 28121 leader_election.cc:290] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 4 election: Requested vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:54.141582 28225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c2297df5ee409099f88f389a23e956" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:54.142109 28336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00c2297df5ee409099f88f389a23e956" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:54.142335 28225 raft_consensus.cc:3055] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:55:54.142661 28336 raft_consensus.cc:3060] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:55:54.142684 28225 raft_consensus.cc:740] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:54.143636 28225 consensus_queue.cc:260] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.144928 28225 raft_consensus.cc:3060] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:55:54.149180 28336 raft_consensus.cc:2468] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 4.
I20260807 07:55:54.150557 28063 leader_election.cc:304] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:54.151799 28225 raft_consensus.cc:2468] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 4.
I20260807 07:55:54.152184 28672 raft_consensus.cc:2804] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:55:54.153126 28672 raft_consensus.cc:697] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 4 LEADER]: Becoming Leader. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Running, Role: LEADER
I20260807 07:55:54.153934 28672 consensus_queue.cc:237] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.160836 27958 catalog_manager.cc:5697] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c reported cstate change: term changed from 3 to 4, leader changed from 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130) to 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129). New cstate: current_term: 4 leader_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:54.223778 28670 raft_consensus.cc:993] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee: : Instructing follower c388fd85be3a4776aa66a26c350e91d9 to start an election
I20260807 07:55:54.224495 28627 raft_consensus.cc:1081] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 5 LEADER]: Signalling peer c388fd85be3a4776aa66a26c350e91d9 to start an election
I20260807 07:55:54.226058 28336 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57"
dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
from {username='slave'} at 127.0.0.1:39184
I20260807 07:55:54.226451 28336 raft_consensus.cc:493] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:54.226675 28336 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:55:54.230701 28336 raft_consensus.cc:515] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.232537 28336 leader_election.cc:290] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 6 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:54.233270 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:54.233601 28225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7d39b5c315e4109b13d54ab02326c57" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:54.233891 28121 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:55:54.234210 28225 raft_consensus.cc:3055] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:55:54.234514 28225 raft_consensus.cc:740] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:54.235253 28225 consensus_queue.cc:260] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.236418 28225 raft_consensus.cc:3060] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:55:54.239770 28121 raft_consensus.cc:2468] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 6.
I20260807 07:55:54.241000 28284 leader_election.cc:304] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:54.241828 28625 raft_consensus.cc:2804] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:55:54.242378 28225 raft_consensus.cc:2468] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 6.
I20260807 07:55:54.243053 28625 raft_consensus.cc:697] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 6 LEADER]: Becoming Leader. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Running, Role: LEADER
I20260807 07:55:54.243929 28625 consensus_queue.cc:237] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.250671 27958 catalog_manager.cc:5697] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 reported cstate change: term changed from 5 to 6, leader changed from 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130) to c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131). New cstate: current_term: 6 leader_uuid: "c388fd85be3a4776aa66a26c350e91d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: HEALTHY } } }
I20260807 07:55:54.330860 28679 raft_consensus.cc:993] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee: : Instructing follower c388fd85be3a4776aa66a26c350e91d9 to start an election
I20260807 07:55:54.331306 28627 raft_consensus.cc:1081] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 3 LEADER]: Signalling peer c388fd85be3a4776aa66a26c350e91d9 to start an election
I20260807 07:55:54.332573 28336 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19531b49699549f988681ad93f142486"
dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
from {username='slave'} at 127.0.0.1:39184
I20260807 07:55:54.332983 28336 raft_consensus.cc:493] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:54.333251 28336 raft_consensus.cc:3060] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:55:54.337168 28336 raft_consensus.cc:515] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.338527 28336 leader_election.cc:290] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 4 election: Requested vote from peers 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679), 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063)
I20260807 07:55:54.339196 28121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19531b49699549f988681ad93f142486" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
I20260807 07:55:54.339514 28225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19531b49699549f988681ad93f142486" candidate_uuid: "c388fd85be3a4776aa66a26c350e91d9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:54.339762 28121 raft_consensus.cc:3060] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:55:54.340051 28225 raft_consensus.cc:3055] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:55:54.340381 28225 raft_consensus.cc:740] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:54.341251 28225 consensus_queue.cc:260] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.342479 28225 raft_consensus.cc:3060] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:55:54.345639 28121 raft_consensus.cc:2468] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 4.
I20260807 07:55:54.346709 28284 leader_election.cc:304] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:54.347530 28625 raft_consensus.cc:2804] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:55:54.347960 28625 raft_consensus.cc:697] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 4 LEADER]: Becoming Leader. State: Replica: c388fd85be3a4776aa66a26c350e91d9, State: Running, Role: LEADER
I20260807 07:55:54.348250 28225 raft_consensus.cc:2468] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c388fd85be3a4776aa66a26c350e91d9 in term 4.
I20260807 07:55:54.348806 28625 consensus_queue.cc:237] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.355638 27958 catalog_manager.cc:5697] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 reported cstate change: term changed from 3 to 4, leader changed from 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130) to c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131). New cstate: current_term: 4 leader_uuid: "c388fd85be3a4776aa66a26c350e91d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: HEALTHY } } }
I20260807 07:55:54.544198 28679 raft_consensus.cc:993] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee: : Instructing follower 52333cbb1cf7443a959e5bb2f7f3069c to start an election
I20260807 07:55:54.544629 28627 raft_consensus.cc:1081] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Signalling peer 52333cbb1cf7443a959e5bb2f7f3069c to start an election
I20260807 07:55:54.546130 28121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4e6d12080cd481e95ea126f9ba401f9"
dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
from {username='slave'} at 127.0.0.1:34820
I20260807 07:55:54.546561 28121 raft_consensus.cc:493] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:54.546816 28121 raft_consensus.cc:3060] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:54.550809 28121 raft_consensus.cc:515] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.552170 28121 leader_election.cc:290] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 2 election: Requested vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:54.552994 28225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e6d12080cd481e95ea126f9ba401f9" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:54.553320 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e6d12080cd481e95ea126f9ba401f9" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:54.553490 28225 raft_consensus.cc:3055] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:55:54.553789 28335 raft_consensus.cc:3060] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:54.553798 28225 raft_consensus.cc:740] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:54.554625 28225 consensus_queue.cc:260] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.555470 28225 raft_consensus.cc:3060] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:54.558213 28335 raft_consensus.cc:2468] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 2.
I20260807 07:55:54.559088 28063 leader_election.cc:304] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:54.559401 28225 raft_consensus.cc:2468] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 2.
I20260807 07:55:54.559808 28672 raft_consensus.cc:2804] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:55:54.560254 28672 raft_consensus.cc:697] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Becoming Leader. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Running, Role: LEADER
I20260807 07:55:54.560982 28672 consensus_queue.cc:237] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.568022 27958 catalog_manager.cc:5697] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c reported cstate change: term changed from 1 to 2, leader changed from 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130) to 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129). New cstate: current_term: 2 leader_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:54.604149 28679 raft_consensus.cc:993] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee: : Instructing follower 52333cbb1cf7443a959e5bb2f7f3069c to start an election
I20260807 07:55:54.604609 28627 raft_consensus.cc:1081] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Signalling peer 52333cbb1cf7443a959e5bb2f7f3069c to start an election
I20260807 07:55:54.605988 28121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c61ff273d6be468982ab05bb74f43355"
dest_uuid: "52333cbb1cf7443a959e5bb2f7f3069c"
from {username='slave'} at 127.0.0.1:34820
I20260807 07:55:54.606449 28121 raft_consensus.cc:493] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:55:54.606766 28121 raft_consensus.cc:3060] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:54.610958 28121 raft_consensus.cc:515] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.612325 28121 leader_election.cc:290] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 2 election: Requested vote from peers 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063), c388fd85be3a4776aa66a26c350e91d9 (127.27.64.131:38123)
I20260807 07:55:54.613240 28225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61ff273d6be468982ab05bb74f43355" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6a39421d9b3449bda922edd1aecff9ee"
I20260807 07:55:54.613340 28335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61ff273d6be468982ab05bb74f43355" candidate_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c388fd85be3a4776aa66a26c350e91d9"
I20260807 07:55:54.613719 28225 raft_consensus.cc:3055] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:55:54.613827 28335 raft_consensus.cc:3060] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:54.613986 28225 raft_consensus.cc:740] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6a39421d9b3449bda922edd1aecff9ee, State: Running, Role: LEADER
I20260807 07:55:54.614599 28225 consensus_queue.cc:260] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.615394 28225 raft_consensus.cc:3060] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:55:54.617920 28335 raft_consensus.cc:2468] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 2.
I20260807 07:55:54.618924 28063 leader_election.cc:304] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52333cbb1cf7443a959e5bb2f7f3069c, c388fd85be3a4776aa66a26c350e91d9; no voters:
I20260807 07:55:54.619570 28672 raft_consensus.cc:2804] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:55:54.619794 28225 raft_consensus.cc:2468] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52333cbb1cf7443a959e5bb2f7f3069c in term 2.
I20260807 07:55:54.620030 28672 raft_consensus.cc:697] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Becoming Leader. State: Replica: 52333cbb1cf7443a959e5bb2f7f3069c, State: Running, Role: LEADER
I20260807 07:55:54.621171 28335 raft_consensus.cc:1275] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 4 FOLLOWER]: Refusing update from remote peer 52333cbb1cf7443a959e5bb2f7f3069c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:55:54.620900 28672 consensus_queue.cc:237] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } }
I20260807 07:55:54.622534 28673 consensus_queue.cc:1048] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:55:54.628736 27958 catalog_manager.cc:5697] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c reported cstate change: term changed from 1 to 2, leader changed from 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130) to 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129). New cstate: current_term: 2 leader_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 } health_report { overall_health: UNKNOWN } } }
I20260807 07:55:54.634663 28225 raft_consensus.cc:1275] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 4 FOLLOWER]: Refusing update from remote peer 52333cbb1cf7443a959e5bb2f7f3069c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:55:54.635953 28673 consensus_queue.cc:1048] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:55:54.701045 28121 raft_consensus.cc:1275] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 6 FOLLOWER]: Refusing update from remote peer c388fd85be3a4776aa66a26c350e91d9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:55:54.702256 28625 consensus_queue.cc:1048] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:55:54.710907 28225 raft_consensus.cc:1275] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 6 FOLLOWER]: Refusing update from remote peer c388fd85be3a4776aa66a26c350e91d9: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:55:54.712504 28694 consensus_queue.cc:1048] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:55:54.874771 28121 raft_consensus.cc:1275] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 4 FOLLOWER]: Refusing update from remote peer c388fd85be3a4776aa66a26c350e91d9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:55:54.876037 28694 consensus_queue.cc:1048] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52333cbb1cf7443a959e5bb2f7f3069c" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 34679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:55:54.884063 28225 raft_consensus.cc:1275] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 4 FOLLOWER]: Refusing update from remote peer c388fd85be3a4776aa66a26c350e91d9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:55:54.885933 28681 consensus_queue.cc:1048] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:55:54.973076 28335 raft_consensus.cc:1275] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Refusing update from remote peer 52333cbb1cf7443a959e5bb2f7f3069c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:54.974448 28673 consensus_queue.cc:1048] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:54.983436 28225 raft_consensus.cc:1275] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Refusing update from remote peer 52333cbb1cf7443a959e5bb2f7f3069c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:54.985785 28704 consensus_queue.cc:1048] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:55:55.099529 28225 raft_consensus.cc:1275] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Refusing update from remote peer 52333cbb1cf7443a959e5bb2f7f3069c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:55.100706 28704 consensus_queue.cc:1048] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a39421d9b3449bda922edd1aecff9ee" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:55.110183 28335 raft_consensus.cc:1275] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Refusing update from remote peer 52333cbb1cf7443a959e5bb2f7f3069c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:55:55.111394 28672 consensus_queue.cc:1048] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c388fd85be3a4776aa66a26c350e91d9" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:55:55.130519 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:55.135326 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:55.135732 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:56.136734 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:56.141600 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:56.142099 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:57.143162 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:57.148378 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:57.148809 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:58.149832 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:58.154772 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:58.155251 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:55:59.156229 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:55:59.161315 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:55:59.161782 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:00.162907 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:00.168079 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:00.168545 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:01.169574 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:01.174450 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:01.174887 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
W20260807 07:56:02.350901 28364 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6060 after lost signal to thread 27911
W20260807 07:56:02.351868 28364 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6740 after lost signal to thread 28012
W20260807 07:56:02.352783 28364 debug-util.cc:398] Leaking SignalData structure 0x7b08001de340 after lost signal to thread 28154
W20260807 07:56:02.354425 28364 debug-util.cc:398] Leaking SignalData structure 0x7b080018c420 after lost signal to thread 28265
W20260807 07:56:02.355563 28364 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd700 after lost signal to thread 28367
I20260807 07:56:02.561854 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:02.570312 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:02.570779 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:03.571959 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:03.576779 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:03.577216 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:04.604601 27906 auto_leader_rebalancer-test.cc:448] The leader distribution is
I20260807 07:56:04.605271 27906 tablet_server.cc:179] TabletServer@127.27.64.129:0 shutting down...
I20260807 07:56:04.639662 27906 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260807 07:56:04.640597 27906 tablet_replica.cc:333] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c: stopping tablet replica
W20260807 07:56:04.641224 28173 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260807 07:56:04.641817 27906 raft_consensus.cc:2243] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Raft consensus shutting down.
I20260807 07:56:04.643173 27906 raft_consensus.cc:2272] T c61ff273d6be468982ab05bb74f43355 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260807 07:56:04.644623 28173 consensus_peers.cc:597] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee -> Peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Couldn't send request to peer 52333cbb1cf7443a959e5bb2f7f3069c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:04.645972 27906 tablet_replica.cc:333] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c: stopping tablet replica
I20260807 07:56:04.646492 27906 raft_consensus.cc:2243] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 LEADER]: Raft consensus shutting down.
I20260807 07:56:04.647208 27906 raft_consensus.cc:2272] T b4e6d12080cd481e95ea126f9ba401f9 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.648842 27906 tablet_replica.cc:333] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c: stopping tablet replica
I20260807 07:56:04.649294 27906 raft_consensus.cc:2243] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 6 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.649782 27906 raft_consensus.cc:2272] T f7d39b5c315e4109b13d54ab02326c57 P 52333cbb1cf7443a959e5bb2f7f3069c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.651369 27906 tablet_replica.cc:333] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c: stopping tablet replica
I20260807 07:56:04.651861 27906 raft_consensus.cc:2243] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.652266 27906 raft_consensus.cc:2272] T 8ca541804d2a4d4884620e683ea84d9b P 52333cbb1cf7443a959e5bb2f7f3069c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.653960 27906 tablet_replica.cc:333] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c: stopping tablet replica
I20260807 07:56:04.654392 27906 raft_consensus.cc:2243] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.654814 27906 raft_consensus.cc:2272] T 19531b49699549f988681ad93f142486 P 52333cbb1cf7443a959e5bb2f7f3069c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.656327 27906 tablet_replica.cc:333] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c: stopping tablet replica
I20260807 07:56:04.656790 27906 raft_consensus.cc:2243] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 4 LEADER]: Raft consensus shutting down.
I20260807 07:56:04.657527 27906 raft_consensus.cc:2272] T 00c2297df5ee409099f88f389a23e956 P 52333cbb1cf7443a959e5bb2f7f3069c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.659147 27906 tablet_replica.cc:333] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c: stopping tablet replica
I20260807 07:56:04.659578 27906 raft_consensus.cc:2243] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.659956 27906 raft_consensus.cc:2272] T 8349b1da04e043bc856961aee4297ea8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.661518 27906 tablet_replica.cc:333] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c: stopping tablet replica
I20260807 07:56:04.661980 27906 raft_consensus.cc:2243] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.662362 27906 raft_consensus.cc:2272] T a4a69e9c16e04008a145d51b5c038be8 P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.663910 27906 tablet_replica.cc:333] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c: stopping tablet replica
I20260807 07:56:04.664336 27906 raft_consensus.cc:2243] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.664722 27906 raft_consensus.cc:2272] T 1e9566c0c8cb4919bf24d678583f9eed P 52333cbb1cf7443a959e5bb2f7f3069c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.779527 27906 tablet_server.cc:196] TabletServer@127.27.64.129:0 shutdown complete.
I20260807 07:56:04.798364 27906 tablet_server.cc:179] TabletServer@127.27.64.130:0 shutting down...
W20260807 07:56:04.818176 28284 consensus_peers.cc:597] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 -> Peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Couldn't send request to peer 52333cbb1cf7443a959e5bb2f7f3069c. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.129:34679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 07:56:04.832177 28173 consensus_peers.cc:597] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee -> Peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Couldn't send request to peer 52333cbb1cf7443a959e5bb2f7f3069c. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.129:34679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 07:56:04.832656 28287 consensus_peers.cc:597] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 -> Peer 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063): Couldn't send request to peer 6a39421d9b3449bda922edd1aecff9ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:04.833144 27906 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260807 07:56:04.833779 27906 tablet_replica.cc:333] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee: stopping tablet replica
I20260807 07:56:04.834419 27906 raft_consensus.cc:2243] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.834903 27906 raft_consensus.cc:2272] T c61ff273d6be468982ab05bb74f43355 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.837303 27906 tablet_replica.cc:333] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee: stopping tablet replica
I20260807 07:56:04.838027 27906 raft_consensus.cc:2243] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.838495 27906 raft_consensus.cc:2272] T b4e6d12080cd481e95ea126f9ba401f9 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Raft consensus is shut down!
W20260807 07:56:04.838508 28284 consensus_peers.cc:597] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 -> Peer 52333cbb1cf7443a959e5bb2f7f3069c (127.27.64.129:34679): Couldn't send request to peer 52333cbb1cf7443a959e5bb2f7f3069c. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.129:34679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:04.840432 27906 tablet_replica.cc:333] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee: stopping tablet replica
I20260807 07:56:04.840955 27906 raft_consensus.cc:2243] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 6 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.841411 27906 raft_consensus.cc:2272] T f7d39b5c315e4109b13d54ab02326c57 P 6a39421d9b3449bda922edd1aecff9ee [term 6 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.843468 27906 tablet_replica.cc:333] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee: stopping tablet replica
I20260807 07:56:04.843936 27906 raft_consensus.cc:2243] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.844368 27906 raft_consensus.cc:2272] T 19531b49699549f988681ad93f142486 P 6a39421d9b3449bda922edd1aecff9ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.846079 27906 tablet_replica.cc:333] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee: stopping tablet replica
I20260807 07:56:04.846529 27906 raft_consensus.cc:2243] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 3 LEADER]: Raft consensus shutting down.
I20260807 07:56:04.847203 27906 raft_consensus.cc:2272] T 8ca541804d2a4d4884620e683ea84d9b P 6a39421d9b3449bda922edd1aecff9ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.848806 27906 tablet_replica.cc:333] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee: stopping tablet replica
I20260807 07:56:04.849248 27906 raft_consensus.cc:2243] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.849650 27906 raft_consensus.cc:2272] T 00c2297df5ee409099f88f389a23e956 P 6a39421d9b3449bda922edd1aecff9ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.851193 27906 tablet_replica.cc:333] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee: stopping tablet replica
I20260807 07:56:04.851634 27906 raft_consensus.cc:2243] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.852007 27906 raft_consensus.cc:2272] T 8349b1da04e043bc856961aee4297ea8 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.853566 27906 tablet_replica.cc:333] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee: stopping tablet replica
I20260807 07:56:04.853996 27906 raft_consensus.cc:2243] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 2 LEADER]: Raft consensus shutting down.
I20260807 07:56:04.854683 27906 raft_consensus.cc:2272] T a4a69e9c16e04008a145d51b5c038be8 P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.856192 27906 tablet_replica.cc:333] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee: stopping tablet replica
I20260807 07:56:04.856583 27906 raft_consensus.cc:2243] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 2 LEADER]: Raft consensus shutting down.
I20260807 07:56:04.857237 27906 raft_consensus.cc:2272] T 1e9566c0c8cb4919bf24d678583f9eed P 6a39421d9b3449bda922edd1aecff9ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.884969 27906 tablet_server.cc:196] TabletServer@127.27.64.130:0 shutdown complete.
I20260807 07:56:04.903438 27906 tablet_server.cc:179] TabletServer@127.27.64.131:0 shutting down...
W20260807 07:56:04.909778 28287 consensus_peers.cc:597] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 -> Peer 6a39421d9b3449bda922edd1aecff9ee (127.27.64.130:35063): Couldn't send request to peer 6a39421d9b3449bda922edd1aecff9ee. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.130:35063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:04.929582 27906 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260807 07:56:04.930213 27906 tablet_replica.cc:333] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9: stopping tablet replica
I20260807 07:56:04.930863 27906 raft_consensus.cc:2243] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.931331 27906 raft_consensus.cc:2272] T c61ff273d6be468982ab05bb74f43355 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.933090 27906 tablet_replica.cc:333] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9: stopping tablet replica
I20260807 07:56:04.933624 27906 raft_consensus.cc:2243] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.934013 27906 raft_consensus.cc:2272] T b4e6d12080cd481e95ea126f9ba401f9 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.935629 27906 tablet_replica.cc:333] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9: stopping tablet replica
I20260807 07:56:04.936116 27906 raft_consensus.cc:2243] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.936522 27906 raft_consensus.cc:2272] T 8ca541804d2a4d4884620e683ea84d9b P c388fd85be3a4776aa66a26c350e91d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.938184 27906 tablet_replica.cc:333] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9: stopping tablet replica
I20260807 07:56:04.938633 27906 raft_consensus.cc:2243] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 4 LEADER]: Raft consensus shutting down.
I20260807 07:56:04.939350 27906 raft_consensus.cc:2272] T 19531b49699549f988681ad93f142486 P c388fd85be3a4776aa66a26c350e91d9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.940912 27906 tablet_replica.cc:333] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9: stopping tablet replica
I20260807 07:56:04.941360 27906 raft_consensus.cc:2243] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [term 2 LEADER]: Raft consensus shutting down.
I20260807 07:56:04.942126 27906 raft_consensus.cc:2272] T 8349b1da04e043bc856961aee4297ea8 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.943691 27906 tablet_replica.cc:333] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9: stopping tablet replica
I20260807 07:56:04.944128 27906 raft_consensus.cc:2243] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.944489 27906 raft_consensus.cc:2272] T a4a69e9c16e04008a145d51b5c038be8 P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.946048 27906 tablet_replica.cc:333] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9: stopping tablet replica
I20260807 07:56:04.946473 27906 raft_consensus.cc:2243] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.946857 27906 raft_consensus.cc:2272] T 1e9566c0c8cb4919bf24d678583f9eed P c388fd85be3a4776aa66a26c350e91d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.948390 27906 tablet_replica.cc:333] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9: stopping tablet replica
I20260807 07:56:04.948823 27906 raft_consensus.cc:2243] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 6 LEADER]: Raft consensus shutting down.
I20260807 07:56:04.949558 27906 raft_consensus.cc:2272] T f7d39b5c315e4109b13d54ab02326c57 P c388fd85be3a4776aa66a26c350e91d9 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.951078 27906 tablet_replica.cc:333] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9: stopping tablet replica
I20260807 07:56:04.951483 27906 raft_consensus.cc:2243] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:04.951905 27906 raft_consensus.cc:2272] T 00c2297df5ee409099f88f389a23e956 P c388fd85be3a4776aa66a26c350e91d9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:04.994640 27906 tablet_server.cc:196] TabletServer@127.27.64.131:0 shutdown complete.
I20260807 07:56:05.012665 27906 master.cc:562] Master@127.27.64.190:36165 shutting down...
I20260807 07:56:05.181360 27906 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:56:05.182044 27906 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:05.182395 27906 tablet_replica.cc:333] T 00000000000000000000000000000000 P c1386f3207d446aea45efc277a5591be: stopping tablet replica
I20260807 07:56:05.201532 27906 master.cc:584] Master@127.27.64.190:36165 shutdown complete.
52333cbb1cf7443a959e5bb2f7f3069c 4
6a39421d9b3449bda922edd1aecff9ee 4
c388fd85be3a4776aa66a26c350e91d9 1
52333cbb1cf7443a959e5bb2f7f3069c 3
6a39421d9b3449bda922edd1aecff9ee 3
c388fd85be3a4776aa66a26c350e91d9 3
52333cbb1cf7443a959e5bb2f7f3069c 0
6a39421d9b3449bda922edd1aecff9ee 8
c388fd85be3a4776aa66a26c350e91d9 1
52333cbb1cf7443a959e5bb2f7f3069c 3
6a39421d9b3449bda922edd1aecff9ee 3
c388fd85be3a4776aa66a26c350e91d9 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (33159 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260807 07:56:05.242400 27906 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.64.190:39429
I20260807 07:56:05.243538 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:56:05.248672 28730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:05.249816 28732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:05.250249 28735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:05.250433 27906 server_base.cc:1061] running on GCE node
I20260807 07:56:05.251611 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:56:05.251799 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:56:05.251962 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089365251945 us; error 0 us; skew 500 ppm
I20260807 07:56:05.252481 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:56:05.254791 27906 webserver.cc:533] Webserver started at http://127.27.64.190:36627/ using document root <none> and password file <none>
I20260807 07:56:05.255265 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:56:05.255450 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:56:05.255716 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:56:05.256844 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/master-0-root/instance:
uuid: "2fdb5674f39848dcb4988f49953d92de"
format_stamp: "Formatted at 2026-08-07 07:56:05 on dist-test-slave-f0tn"
I20260807 07:56:05.261322 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 07:56:05.264664 28744 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:05.265345 27906 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 07:56:05.265635 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/master-0-root
uuid: "2fdb5674f39848dcb4988f49953d92de"
format_stamp: "Formatted at 2026-08-07 07:56:05 on dist-test-slave-f0tn"
I20260807 07:56:05.265901 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:56:05.279786 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:56:05.280942 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:56:05.320087 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.190:39429
I20260807 07:56:05.320195 28842 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.190:39429 every 8 connection(s)
I20260807 07:56:05.324072 28843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.333776 28843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de: Bootstrap starting.
I20260807 07:56:05.338467 28843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:05.342806 28843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de: No bootstrap required, opened a new log
I20260807 07:56:05.345007 28843 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fdb5674f39848dcb4988f49953d92de" member_type: VOTER }
I20260807 07:56:05.345461 28843 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:05.345701 28843 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fdb5674f39848dcb4988f49953d92de, State: Initialized, Role: FOLLOWER
I20260807 07:56:05.346285 28843 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fdb5674f39848dcb4988f49953d92de" member_type: VOTER }
I20260807 07:56:05.346763 28843 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:56:05.347005 28843 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:56:05.347263 28843 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:05.351231 28843 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fdb5674f39848dcb4988f49953d92de" member_type: VOTER }
I20260807 07:56:05.351729 28843 leader_election.cc:304] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fdb5674f39848dcb4988f49953d92de; no voters:
I20260807 07:56:05.352876 28843 leader_election.cc:290] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:56:05.353242 28847 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:05.354496 28847 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [term 1 LEADER]: Becoming Leader. State: Replica: 2fdb5674f39848dcb4988f49953d92de, State: Running, Role: LEADER
I20260807 07:56:05.355177 28847 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fdb5674f39848dcb4988f49953d92de" member_type: VOTER }
I20260807 07:56:05.355723 28843 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:56:05.360275 28849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fdb5674f39848dcb4988f49953d92de. Latest consensus state: current_term: 1 leader_uuid: "2fdb5674f39848dcb4988f49953d92de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fdb5674f39848dcb4988f49953d92de" member_type: VOTER } }
I20260807 07:56:05.360419 28848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fdb5674f39848dcb4988f49953d92de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fdb5674f39848dcb4988f49953d92de" member_type: VOTER } }
I20260807 07:56:05.361011 28849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [sys.catalog]: This master's current role is: LEADER
I20260807 07:56:05.361275 28848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [sys.catalog]: This master's current role is: LEADER
I20260807 07:56:05.362854 28855 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260807 07:56:05.368103 28855 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260807 07:56:05.371521 27906 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 07:56:05.377022 28855 catalog_manager.cc:1383] Generated new cluster ID: 7aabd37666da465298e42254deba814b
I20260807 07:56:05.377322 28855 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260807 07:56:05.393040 28855 catalog_manager.cc:1406] Generated new certificate authority record
I20260807 07:56:05.394261 28855 catalog_manager.cc:1540] Loading token signing keys...
I20260807 07:56:05.410986 28855 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de: Generated new TSK 0
I20260807 07:56:05.411590 28855 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260807 07:56:05.438047 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:56:05.443900 28869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:05.444684 28870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:05.447005 27906 server_base.cc:1061] running on GCE node
W20260807 07:56:05.446935 28878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:05.448167 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:56:05.448345 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:56:05.448462 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089365448451 us; error 0 us; skew 500 ppm
I20260807 07:56:05.448904 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:56:05.450971 27906 webserver.cc:533] Webserver started at http://127.27.64.129:35175/ using document root <none> and password file <none>
I20260807 07:56:05.451413 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:56:05.451570 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:56:05.451813 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:56:05.452852 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-0-root/instance:
uuid: "06730445eab14c99872e29a97027bf10"
format_stamp: "Formatted at 2026-08-07 07:56:05 on dist-test-slave-f0tn"
I20260807 07:56:05.457198 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260807 07:56:05.460253 28886 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:05.460911 27906 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 07:56:05.461176 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-0-root
uuid: "06730445eab14c99872e29a97027bf10"
format_stamp: "Formatted at 2026-08-07 07:56:05 on dist-test-slave-f0tn"
I20260807 07:56:05.461465 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:56:05.472791 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:56:05.474004 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:56:05.475451 27906 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 07:56:05.477797 27906 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:56:05.478006 27906 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:05.478224 27906 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 07:56:05.478370 27906 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:05.518107 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.129:42229
I20260807 07:56:05.518225 28975 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.129:42229 every 8 connection(s)
I20260807 07:56:05.522822 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:56:05.530499 28985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:05.531504 28986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:05.535267 28990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:05.536288 27906 server_base.cc:1061] running on GCE node
I20260807 07:56:05.536767 28976 heartbeater.cc:344] Connected to a master server at 127.27.64.190:39429
I20260807 07:56:05.537129 28976 heartbeater.cc:461] Registering TS with master...
I20260807 07:56:05.537513 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:56:05.537708 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:56:05.537868 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089365537851 us; error 0 us; skew 500 ppm
I20260807 07:56:05.537921 28976 heartbeater.cc:507] Master 127.27.64.190:39429 requested a full tablet report, sending...
I20260807 07:56:05.538447 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:56:05.540172 28785 ts_manager.cc:194] Registered new tserver with Master: 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229)
I20260807 07:56:05.541340 27906 webserver.cc:533] Webserver started at http://127.27.64.130:37077/ using document root <none> and password file <none>
I20260807 07:56:05.541898 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:56:05.542073 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:56:05.542122 28785 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38116
I20260807 07:56:05.542366 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:56:05.543740 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-1-root/instance:
uuid: "313fe8fb51e84e1ea251584f55792fce"
format_stamp: "Formatted at 2026-08-07 07:56:05 on dist-test-slave-f0tn"
I20260807 07:56:05.548080 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 07:56:05.551283 28996 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:05.551963 27906 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 07:56:05.552235 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-1-root
uuid: "313fe8fb51e84e1ea251584f55792fce"
format_stamp: "Formatted at 2026-08-07 07:56:05 on dist-test-slave-f0tn"
I20260807 07:56:05.552506 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:56:05.564380 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:56:05.565536 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:56:05.566963 27906 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 07:56:05.569572 27906 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:56:05.569823 27906 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:05.570099 27906 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 07:56:05.570314 27906 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:05.609954 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.130:41877
I20260807 07:56:05.610085 29086 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.130:41877 every 8 connection(s)
I20260807 07:56:05.620079 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:56:05.626572 29093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:05.628170 29094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:05.628837 29087 heartbeater.cc:344] Connected to a master server at 127.27.64.190:39429
I20260807 07:56:05.629171 29087 heartbeater.cc:461] Registering TS with master...
I20260807 07:56:05.630108 29087 heartbeater.cc:507] Master 127.27.64.190:39429 requested a full tablet report, sending...
I20260807 07:56:05.631981 27906 server_base.cc:1061] running on GCE node
W20260807 07:56:05.632057 29096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:05.632441 28785 ts_manager.cc:194] Registered new tserver with Master: 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:05.633116 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:56:05.633420 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:56:05.633625 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089365633606 us; error 0 us; skew 500 ppm
I20260807 07:56:05.634240 28785 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38118
I20260807 07:56:05.634353 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:56:05.636878 27906 webserver.cc:533] Webserver started at http://127.27.64.131:44267/ using document root <none> and password file <none>
I20260807 07:56:05.637328 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:56:05.637547 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:56:05.637765 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:56:05.638870 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-2-root/instance:
uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
format_stamp: "Formatted at 2026-08-07 07:56:05 on dist-test-slave-f0tn"
I20260807 07:56:05.643325 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 07:56:05.646540 29108 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:05.647264 27906 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 07:56:05.647534 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-2-root
uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
format_stamp: "Formatted at 2026-08-07 07:56:05 on dist-test-slave-f0tn"
I20260807 07:56:05.647800 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1786089331872967-27906-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:56:05.663545 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:56:05.664723 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:56:05.666230 27906 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 07:56:05.668553 27906 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:56:05.668741 27906 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:05.668972 27906 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 07:56:05.669123 27906 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:05.708176 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.131:42527
I20260807 07:56:05.708288 29219 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.131:42527 every 8 connection(s)
I20260807 07:56:05.721709 29220 heartbeater.cc:344] Connected to a master server at 127.27.64.190:39429
I20260807 07:56:05.722108 29220 heartbeater.cc:461] Registering TS with master...
I20260807 07:56:05.722810 29220 heartbeater.cc:507] Master 127.27.64.190:39429 requested a full tablet report, sending...
I20260807 07:56:05.724743 28785 ts_manager.cc:194] Registered new tserver with Master: b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:05.725507 27906 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014278269s
I20260807 07:56:05.726070 28785 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38122
I20260807 07:56:05.749428 28785 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38130:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 07:56:05.752274 28785 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 07:56:05.826728 29159 tablet_service.cc:1511] Processing CreateTablet for tablet e6901eb624c64f168d9b8e6668309d5d (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 07:56:05.828217 29159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6901eb624c64f168d9b8e6668309d5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.828130 29146 tablet_service.cc:1511] Processing CreateTablet for tablet b0d1eb69c6d349e197aec078a5013c8f (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 07:56:05.829538 29146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d1eb69c6d349e197aec078a5013c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.830983 29147 tablet_service.cc:1511] Processing CreateTablet for tablet d368970ae10540af9ea28923e3cf4dc5 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 07:56:05.832299 29147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d368970ae10540af9ea28923e3cf4dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.832980 29144 tablet_service.cc:1511] Processing CreateTablet for tablet c6f73f08eb7b4d2388d75f7c0bed25a6 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 07:56:05.834255 29144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f73f08eb7b4d2388d75f7c0bed25a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.838981 29148 tablet_service.cc:1511] Processing CreateTablet for tablet 417e6900e83d489b86a1417e4cd74169 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 07:56:05.839800 29036 tablet_service.cc:1511] Processing CreateTablet for tablet e6901eb624c64f168d9b8e6668309d5d (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 07:56:05.840303 29148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 417e6900e83d489b86a1417e4cd74169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.841017 29036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6901eb624c64f168d9b8e6668309d5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.838510 29142 tablet_service.cc:1511] Processing CreateTablet for tablet 4dc7fe03092c42cba6694d2a11392e15 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 07:56:05.841797 29158 tablet_service.cc:1511] Processing CreateTablet for tablet 8989db03218b4cdf997e655dcc849c8e (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 07:56:05.843210 29141 tablet_service.cc:1511] Processing CreateTablet for tablet a5c1109e73ab4e2198a3018c92a9f63a (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 07:56:05.843597 29031 tablet_service.cc:1511] Processing CreateTablet for tablet d368970ae10540af9ea28923e3cf4dc5 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 07:56:05.844933 29031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d368970ae10540af9ea28923e3cf4dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.846228 29030 tablet_service.cc:1511] Processing CreateTablet for tablet b0d1eb69c6d349e197aec078a5013c8f (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 07:56:05.846469 29034 tablet_service.cc:1511] Processing CreateTablet for tablet 8989db03218b4cdf997e655dcc849c8e (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 07:56:05.846771 29029 tablet_service.cc:1511] Processing CreateTablet for tablet c6f73f08eb7b4d2388d75f7c0bed25a6 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 07:56:05.847555 29030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d1eb69c6d349e197aec078a5013c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.848176 29033 tablet_service.cc:1511] Processing CreateTablet for tablet 417e6900e83d489b86a1417e4cd74169 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 07:56:05.849213 29028 tablet_service.cc:1511] Processing CreateTablet for tablet 4dc7fe03092c42cba6694d2a11392e15 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 07:56:05.849893 29029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f73f08eb7b4d2388d75f7c0bed25a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.850492 29028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc7fe03092c42cba6694d2a11392e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.843641 29158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8989db03218b4cdf997e655dcc849c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.852748 29033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 417e6900e83d489b86a1417e4cd74169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.853919 29142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc7fe03092c42cba6694d2a11392e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.854046 29034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8989db03218b4cdf997e655dcc849c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.856150 29027 tablet_service.cc:1511] Processing CreateTablet for tablet a5c1109e73ab4e2198a3018c92a9f63a (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 07:56:05.857426 29027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c1109e73ab4e2198a3018c92a9f63a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.862432 29141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c1109e73ab4e2198a3018c92a9f63a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.899682 29242 tablet_bootstrap.cc:492] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2: Bootstrap starting.
I20260807 07:56:05.901773 29033 tablet_service.cc:1511] Processing CreateTablet for tablet 26a136c96874492cbf476b53d967403e (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 07:56:05.904541 29033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26a136c96874492cbf476b53d967403e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.913036 29029 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea4142012de4b6ea3550c5a9178a116 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 07:56:05.914016 28918 tablet_service.cc:1511] Processing CreateTablet for tablet a5c1109e73ab4e2198a3018c92a9f63a (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260807 07:56:05.914541 28929 tablet_service.cc:1511] Processing CreateTablet for tablet e6901eb624c64f168d9b8e6668309d5d (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260807 07:56:05.904641 29243 tablet_bootstrap.cc:492] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce: Bootstrap starting.
I20260807 07:56:05.916261 28917 tablet_service.cc:1511] Processing CreateTablet for tablet 26a136c96874492cbf476b53d967403e (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 07:56:05.918610 29029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea4142012de4b6ea3550c5a9178a116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.919143 29242 tablet_bootstrap.cc:654] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:05.918634 28918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c1109e73ab4e2198a3018c92a9f63a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.929068 28923 tablet_service.cc:1511] Processing CreateTablet for tablet d368970ae10540af9ea28923e3cf4dc5 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260807 07:56:05.931703 28923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d368970ae10540af9ea28923e3cf4dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.930112 29141 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea4142012de4b6ea3550c5a9178a116 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 07:56:05.932902 29141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea4142012de4b6ea3550c5a9178a116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.933787 28917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26a136c96874492cbf476b53d967403e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.929744 28927 tablet_service.cc:1511] Processing CreateTablet for tablet 417e6900e83d489b86a1417e4cd74169 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260807 07:56:05.930189 28919 tablet_service.cc:1511] Processing CreateTablet for tablet 4dc7fe03092c42cba6694d2a11392e15 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260807 07:56:05.936419 28927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 417e6900e83d489b86a1417e4cd74169. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.918671 28928 tablet_service.cc:1511] Processing CreateTablet for tablet 8989db03218b4cdf997e655dcc849c8e (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260807 07:56:05.921854 28921 tablet_service.cc:1511] Processing CreateTablet for tablet c6f73f08eb7b4d2388d75f7c0bed25a6 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260807 07:56:05.921411 28922 tablet_service.cc:1511] Processing CreateTablet for tablet b0d1eb69c6d349e197aec078a5013c8f (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260807 07:56:05.937795 28919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc7fe03092c42cba6694d2a11392e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.942631 28916 tablet_service.cc:1511] Processing CreateTablet for tablet 8ea4142012de4b6ea3550c5a9178a116 (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260807 07:56:05.945998 28929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6901eb624c64f168d9b8e6668309d5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.948140 28922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d1eb69c6d349e197aec078a5013c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.950839 28916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ea4142012de4b6ea3550c5a9178a116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.953236 28921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f73f08eb7b4d2388d75f7c0bed25a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.964669 28928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8989db03218b4cdf997e655dcc849c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:05.958798 29146 tablet_service.cc:1511] Processing CreateTablet for tablet 26a136c96874492cbf476b53d967403e (DEFAULT_TABLE table=test-workload [id=b16a00899b00486eb4f87dd796e9832e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260807 07:56:05.977469 29146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26a136c96874492cbf476b53d967403e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:06.022038 29243 tablet_bootstrap.cc:654] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.041647 29244 tablet_bootstrap.cc:492] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10: Bootstrap starting.
I20260807 07:56:06.039753 29242 tablet_bootstrap.cc:492] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2: No bootstrap required, opened a new log
I20260807 07:56:06.046078 29242 ts_tablet_manager.cc:1403] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent bootstrapping tablet: real 0.147s user 0.013s sys 0.000s
I20260807 07:56:06.046516 29243 tablet_bootstrap.cc:492] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce: No bootstrap required, opened a new log
I20260807 07:56:06.047132 29243 ts_tablet_manager.cc:1403] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce: Time spent bootstrapping tablet: real 0.143s user 0.006s sys 0.012s
I20260807 07:56:06.048225 29244 tablet_bootstrap.cc:654] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.049050 29242 raft_consensus.cc:359] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.054675 29242 raft_consensus.cc:385] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.055020 29242 raft_consensus.cc:740] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.054842 29243 raft_consensus.cc:359] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.055596 29243 raft_consensus.cc:385] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.055927 29243 raft_consensus.cc:740] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.055893 29242 consensus_queue.cc:260] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.056803 29243 consensus_queue.cc:260] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.058023 29244 tablet_bootstrap.cc:492] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10: No bootstrap required, opened a new log
I20260807 07:56:06.059127 29244 ts_tablet_manager.cc:1403] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.004s
I20260807 07:56:06.062278 29244 raft_consensus.cc:359] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.065109 29244 raft_consensus.cc:385] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.065821 29244 raft_consensus.cc:740] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.067436 29244 consensus_queue.cc:260] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.068121 29087 heartbeater.cc:499] Master 127.27.64.190:39429 was elected leader, sending a full tablet report...
I20260807 07:56:06.068976 29220 heartbeater.cc:499] Master 127.27.64.190:39429 was elected leader, sending a full tablet report...
I20260807 07:56:06.069418 29242 ts_tablet_manager.cc:1434] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent starting tablet: real 0.023s user 0.005s sys 0.010s
I20260807 07:56:06.069418 29243 ts_tablet_manager.cc:1434] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce: Time spent starting tablet: real 0.022s user 0.008s sys 0.002s
I20260807 07:56:06.070608 29243 tablet_bootstrap.cc:492] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce: Bootstrap starting.
I20260807 07:56:06.070609 29242 tablet_bootstrap.cc:492] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2: Bootstrap starting.
I20260807 07:56:06.077101 29243 tablet_bootstrap.cc:654] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.077100 29242 tablet_bootstrap.cc:654] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.088990 29242 tablet_bootstrap.cc:492] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2: No bootstrap required, opened a new log
I20260807 07:56:06.088994 29243 tablet_bootstrap.cc:492] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce: No bootstrap required, opened a new log
I20260807 07:56:06.089720 29242 ts_tablet_manager.cc:1403] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent bootstrapping tablet: real 0.019s user 0.014s sys 0.004s
I20260807 07:56:06.089785 29243 ts_tablet_manager.cc:1403] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce: Time spent bootstrapping tablet: real 0.019s user 0.018s sys 0.000s
I20260807 07:56:06.092746 29243 raft_consensus.cc:359] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.092950 29242 raft_consensus.cc:359] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.093645 29242 raft_consensus.cc:385] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.093652 29243 raft_consensus.cc:385] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.094074 29242 raft_consensus.cc:740] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.094174 29243 raft_consensus.cc:740] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.095034 29242 consensus_queue.cc:260] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.095114 29243 consensus_queue.cc:260] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.097208 29242 ts_tablet_manager.cc:1434] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent starting tablet: real 0.007s user 0.000s sys 0.004s
I20260807 07:56:06.097252 29243 ts_tablet_manager.cc:1434] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 07:56:06.098255 29242 tablet_bootstrap.cc:492] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2: Bootstrap starting.
I20260807 07:56:06.098363 29243 tablet_bootstrap.cc:492] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce: Bootstrap starting.
I20260807 07:56:06.100567 28976 heartbeater.cc:499] Master 127.27.64.190:39429 was elected leader, sending a full tablet report...
I20260807 07:56:06.105048 29242 tablet_bootstrap.cc:654] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.105057 29243 tablet_bootstrap.cc:654] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.106329 29244 ts_tablet_manager.cc:1434] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10: Time spent starting tablet: real 0.047s user 0.022s sys 0.012s
I20260807 07:56:06.107353 29244 tablet_bootstrap.cc:492] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10: Bootstrap starting.
I20260807 07:56:06.114095 29244 tablet_bootstrap.cc:654] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.116829 29243 tablet_bootstrap.cc:492] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce: No bootstrap required, opened a new log
I20260807 07:56:06.116847 29242 tablet_bootstrap.cc:492] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2: No bootstrap required, opened a new log
I20260807 07:56:06.117455 29243 ts_tablet_manager.cc:1403] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.013s
I20260807 07:56:06.117460 29242 ts_tablet_manager.cc:1403] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.008s
W20260807 07:56:06.119802 29088 tablet.cc:2406] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:56:06.120712 29242 raft_consensus.cc:359] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.120713 29243 raft_consensus.cc:359] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.121594 29242 raft_consensus.cc:385] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.121791 29243 raft_consensus.cc:385] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.121984 29242 raft_consensus.cc:740] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.122246 29243 raft_consensus.cc:740] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.122946 29242 consensus_queue.cc:260] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.123193 29243 consensus_queue.cc:260] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.124174 29244 tablet_bootstrap.cc:492] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10: No bootstrap required, opened a new log
I20260807 07:56:06.124655 29244 ts_tablet_manager.cc:1403] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.000s
I20260807 07:56:06.125311 29242 ts_tablet_manager.cc:1434] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 07:56:06.125420 29243 ts_tablet_manager.cc:1434] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 07:56:06.126417 29243 tablet_bootstrap.cc:492] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce: Bootstrap starting.
I20260807 07:56:06.126423 29242 tablet_bootstrap.cc:492] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2: Bootstrap starting.
I20260807 07:56:06.127641 29244 raft_consensus.cc:359] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.128358 29244 raft_consensus.cc:385] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.128777 29244 raft_consensus.cc:740] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.129678 29244 consensus_queue.cc:260] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.132290 29244 ts_tablet_manager.cc:1434] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10: Time spent starting tablet: real 0.007s user 0.008s sys 0.001s
I20260807 07:56:06.133194 29244 tablet_bootstrap.cc:492] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10: Bootstrap starting.
I20260807 07:56:06.133527 29242 tablet_bootstrap.cc:654] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.133998 29243 tablet_bootstrap.cc:654] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.139127 29244 tablet_bootstrap.cc:654] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.144699 29242 tablet_bootstrap.cc:492] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2: No bootstrap required, opened a new log
I20260807 07:56:06.145171 29242 ts_tablet_manager.cc:1403] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.009s
I20260807 07:56:06.145273 29243 tablet_bootstrap.cc:492] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce: No bootstrap required, opened a new log
I20260807 07:56:06.145848 29243 ts_tablet_manager.cc:1403] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.010s
I20260807 07:56:06.148110 29242 raft_consensus.cc:359] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.148810 29242 raft_consensus.cc:385] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.149096 29242 raft_consensus.cc:740] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.149989 29243 raft_consensus.cc:359] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:06.150141 29242 consensus_queue.cc:260] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.150858 29243 raft_consensus.cc:385] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.151254 29243 raft_consensus.cc:740] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.152127 29243 consensus_queue.cc:260] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:06.154101 29242 ts_tablet_manager.cc:1434] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260807 07:56:06.154461 29243 ts_tablet_manager.cc:1434] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce: Time spent starting tablet: real 0.008s user 0.005s sys 0.002s
I20260807 07:56:06.155076 29242 tablet_bootstrap.cc:492] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2: Bootstrap starting.
I20260807 07:56:06.155423 29243 tablet_bootstrap.cc:492] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce: Bootstrap starting.
I20260807 07:56:06.161660 29243 tablet_bootstrap.cc:654] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.161660 29242 tablet_bootstrap.cc:654] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.174182 29242 tablet_bootstrap.cc:492] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2: No bootstrap required, opened a new log
I20260807 07:56:06.174558 29243 tablet_bootstrap.cc:492] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce: No bootstrap required, opened a new log
I20260807 07:56:06.174680 29242 ts_tablet_manager.cc:1403] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.010s
I20260807 07:56:06.175127 29243 ts_tablet_manager.cc:1403] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.007s
I20260807 07:56:06.177546 29242 raft_consensus.cc:359] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.178256 29242 raft_consensus.cc:385] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.177857 29243 raft_consensus.cc:359] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.178560 29242 raft_consensus.cc:740] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.178704 29243 raft_consensus.cc:385] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.179104 29243 raft_consensus.cc:740] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.179518 29242 consensus_queue.cc:260] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.179857 29243 consensus_queue.cc:260] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.181807 29248 raft_consensus.cc:493] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.182283 29248 raft_consensus.cc:515] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.183611 29242 ts_tablet_manager.cc:1434] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent starting tablet: real 0.009s user 0.002s sys 0.005s
I20260807 07:56:06.184583 29242 tablet_bootstrap.cc:492] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2: Bootstrap starting.
I20260807 07:56:06.185079 29243 ts_tablet_manager.cc:1434] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260807 07:56:06.186074 29243 tablet_bootstrap.cc:492] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce: Bootstrap starting.
I20260807 07:56:06.190838 29242 tablet_bootstrap.cc:654] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.192400 29243 tablet_bootstrap.cc:654] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.202900 29248 leader_election.cc:290] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:06.203243 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:06.204499 29243 tablet_bootstrap.cc:492] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce: No bootstrap required, opened a new log
W20260807 07:56:06.204950 29112 leader_election.cc:343] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:06.205147 29243 ts_tablet_manager.cc:1403] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.004s
I20260807 07:56:06.208455 29243 raft_consensus.cc:359] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.209473 29243 raft_consensus.cc:385] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.209851 29243 raft_consensus.cc:740] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.210724 29243 consensus_queue.cc:260] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.216352 29244 tablet_bootstrap.cc:492] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10: No bootstrap required, opened a new log
I20260807 07:56:06.216538 29243 ts_tablet_manager.cc:1434] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260807 07:56:06.216874 29244 ts_tablet_manager.cc:1403] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10: Time spent bootstrapping tablet: real 0.084s user 0.034s sys 0.012s
I20260807 07:56:06.217942 29243 tablet_bootstrap.cc:492] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce: Bootstrap starting.
I20260807 07:56:06.223232 29244 raft_consensus.cc:359] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.223971 29244 raft_consensus.cc:385] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.224274 29244 raft_consensus.cc:740] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.225143 29244 consensus_queue.cc:260] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.225600 29243 tablet_bootstrap.cc:654] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.230129 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:06.230892 29050 raft_consensus.cc:2468] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 0.
I20260807 07:56:06.230959 29244 ts_tablet_manager.cc:1434] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10: Time spent starting tablet: real 0.014s user 0.008s sys 0.000s
I20260807 07:56:06.232640 29110 leader_election.cc:304] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10
I20260807 07:56:06.233558 29248 raft_consensus.cc:2804] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:06.233897 29248 raft_consensus.cc:493] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:06.234225 29248 raft_consensus.cc:3060] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.236140 29243 tablet_bootstrap.cc:492] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce: No bootstrap required, opened a new log
I20260807 07:56:06.236562 29243 ts_tablet_manager.cc:1403] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.008s
I20260807 07:56:06.239486 29243 raft_consensus.cc:359] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.240176 29243 raft_consensus.cc:385] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.240460 29243 raft_consensus.cc:740] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.240818 29248 raft_consensus.cc:515] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.241060 29243 consensus_queue.cc:260] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.242748 29244 tablet_bootstrap.cc:492] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10: Bootstrap starting.
I20260807 07:56:06.243721 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:06.244019 29242 tablet_bootstrap.cc:492] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2: No bootstrap required, opened a new log
I20260807 07:56:06.244470 29242 ts_tablet_manager.cc:1403] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent bootstrapping tablet: real 0.060s user 0.009s sys 0.035s
W20260807 07:56:06.245158 29112 leader_election.cc:343] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:06.247252 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:06.247421 29242 raft_consensus.cc:359] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:06.247792 29050 raft_consensus.cc:3060] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.248117 29242 raft_consensus.cc:385] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.248404 29242 raft_consensus.cc:740] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.248636 29244 tablet_bootstrap.cc:654] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.249133 29242 consensus_queue.cc:260] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:06.250200 29243 ts_tablet_manager.cc:1434] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce: Time spent starting tablet: real 0.013s user 0.008s sys 0.000s
I20260807 07:56:06.255759 29050 raft_consensus.cc:2468] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 1.
I20260807 07:56:06.257182 29110 leader_election.cc:304] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10
I20260807 07:56:06.258749 29243 tablet_bootstrap.cc:492] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce: Bootstrap starting.
I20260807 07:56:06.261559 29248 leader_election.cc:290] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:06.265247 29244 tablet_bootstrap.cc:492] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10: No bootstrap required, opened a new log
I20260807 07:56:06.266500 29243 tablet_bootstrap.cc:654] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.267751 29244 ts_tablet_manager.cc:1403] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10: Time spent bootstrapping tablet: real 0.034s user 0.012s sys 0.007s
I20260807 07:56:06.269609 29248 raft_consensus.cc:2804] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:06.270097 29248 raft_consensus.cc:697] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Becoming Leader. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:06.270655 29244 raft_consensus.cc:359] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:06.270885 29248 consensus_queue.cc:237] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.271379 29244 raft_consensus.cc:385] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.271689 29244 raft_consensus.cc:740] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.276527 29242 ts_tablet_manager.cc:1434] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent starting tablet: real 0.032s user 0.015s sys 0.015s
I20260807 07:56:06.277697 29242 tablet_bootstrap.cc:492] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2: Bootstrap starting.
I20260807 07:56:06.281401 29244 consensus_queue.cc:260] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:06.284900 29242 tablet_bootstrap.cc:654] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.285822 28773 catalog_manager.cc:5697] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131). New cstate: current_term: 1 leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:06.287652 29244 ts_tablet_manager.cc:1434] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10: Time spent starting tablet: real 0.020s user 0.003s sys 0.003s
I20260807 07:56:06.288630 29244 tablet_bootstrap.cc:492] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10: Bootstrap starting.
I20260807 07:56:06.299911 29244 tablet_bootstrap.cc:654] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.303686 29243 tablet_bootstrap.cc:492] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce: No bootstrap required, opened a new log
I20260807 07:56:06.304133 29243 ts_tablet_manager.cc:1403] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce: Time spent bootstrapping tablet: real 0.046s user 0.019s sys 0.022s
I20260807 07:56:06.306620 29243 raft_consensus.cc:359] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.307276 29243 raft_consensus.cc:385] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.307556 29243 raft_consensus.cc:740] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.308120 29243 consensus_queue.cc:260] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.309854 29243 ts_tablet_manager.cc:1434] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce: Time spent starting tablet: real 0.005s user 0.003s sys 0.004s
I20260807 07:56:06.311115 29243 tablet_bootstrap.cc:492] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce: Bootstrap starting.
I20260807 07:56:06.312747 29242 tablet_bootstrap.cc:492] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2: No bootstrap required, opened a new log
I20260807 07:56:06.313228 29242 ts_tablet_manager.cc:1403] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.017s
I20260807 07:56:06.314172 29244 tablet_bootstrap.cc:492] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10: No bootstrap required, opened a new log
I20260807 07:56:06.314664 29244 ts_tablet_manager.cc:1403] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.008s
I20260807 07:56:06.316002 29242 raft_consensus.cc:359] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.316545 29243 tablet_bootstrap.cc:654] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.316715 29242 raft_consensus.cc:385] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.317093 29242 raft_consensus.cc:740] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.317396 29244 raft_consensus.cc:359] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.318140 29244 raft_consensus.cc:385] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.317932 29242 consensus_queue.cc:260] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.318457 29244 raft_consensus.cc:740] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.319273 29244 consensus_queue.cc:260] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.323043 29242 ts_tablet_manager.cc:1434] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260807 07:56:06.323494 29244 ts_tablet_manager.cc:1434] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260807 07:56:06.324010 29242 tablet_bootstrap.cc:492] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2: Bootstrap starting.
I20260807 07:56:06.324496 29244 tablet_bootstrap.cc:492] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10: Bootstrap starting.
I20260807 07:56:06.328961 29277 raft_consensus.cc:493] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.329502 29277 raft_consensus.cc:515] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:06.331648 29244 tablet_bootstrap.cc:654] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.334208 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6901eb624c64f168d9b8e6668309d5d" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:06.334836 28942 raft_consensus.cc:2468] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 0.
I20260807 07:56:06.336715 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6901eb624c64f168d9b8e6668309d5d" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:06.336983 29112 leader_election.cc:304] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:06.337440 29050 raft_consensus.cc:2468] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 0.
I20260807 07:56:06.331773 29277 leader_election.cc:290] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229)
I20260807 07:56:06.337805 29248 raft_consensus.cc:2804] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:06.338279 29248 raft_consensus.cc:493] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:06.338619 29248 raft_consensus.cc:3060] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.340081 29242 tablet_bootstrap.cc:654] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.348368 29248 raft_consensus.cc:515] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:06.351327 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6901eb624c64f168d9b8e6668309d5d" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:06.351751 29242 tablet_bootstrap.cc:492] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2: No bootstrap required, opened a new log
I20260807 07:56:06.351900 29050 raft_consensus.cc:3060] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.352208 29242 ts_tablet_manager.cc:1403] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.010s
I20260807 07:56:06.354708 29244 tablet_bootstrap.cc:492] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10: No bootstrap required, opened a new log
I20260807 07:56:06.354887 29242 raft_consensus.cc:359] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.355584 29242 raft_consensus.cc:385] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.355855 29242 raft_consensus.cc:740] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.355273 29244 ts_tablet_manager.cc:1403] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10: Time spent bootstrapping tablet: real 0.031s user 0.010s sys 0.012s
I20260807 07:56:06.356525 29242 consensus_queue.cc:260] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.358443 29050 raft_consensus.cc:2468] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 1.
I20260807 07:56:06.359463 29244 raft_consensus.cc:359] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.359681 29110 leader_election.cc:304] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:06.360158 29244 raft_consensus.cc:385] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.360440 29244 raft_consensus.cc:740] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.360549 29277 raft_consensus.cc:2804] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:06.361006 29277 raft_consensus.cc:697] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Becoming Leader. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:06.361183 29244 consensus_queue.cc:260] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.361897 29277 consensus_queue.cc:237] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:06.364619 29244 ts_tablet_manager.cc:1434] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
W20260807 07:56:06.366516 28858 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:56:06.368049 29275 raft_consensus.cc:493] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.368534 29275 raft_consensus.cc:515] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.370230 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6901eb624c64f168d9b8e6668309d5d" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:06.370630 29275 leader_election.cc:290] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:06.370757 28942 raft_consensus.cc:3060] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.372152 29242 ts_tablet_manager.cc:1434] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent starting tablet: real 0.020s user 0.006s sys 0.002s
I20260807 07:56:06.372303 29248 leader_election.cc:290] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Requested vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229)
I20260807 07:56:06.373342 29242 tablet_bootstrap.cc:492] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2: Bootstrap starting.
I20260807 07:56:06.365713 29244 tablet_bootstrap.cc:492] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10: Bootstrap starting.
I20260807 07:56:06.377030 29250 raft_consensus.cc:493] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.377496 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:06.378157 28941 raft_consensus.cc:2468] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 0.
I20260807 07:56:06.379472 29112 leader_election.cc:304] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:06.377525 29250 raft_consensus.cc:515] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.382725 29244 tablet_bootstrap.cc:654] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.382799 29250 leader_election.cc:290] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:06.386508 29248 raft_consensus.cc:493] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.386973 29248 raft_consensus.cc:515] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.386139 29275 raft_consensus.cc:2804] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:06.391870 29275 raft_consensus.cc:493] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:06.392248 29275 raft_consensus.cc:3060] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.398551 29242 tablet_bootstrap.cc:654] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.392666 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:06.403292 28942 raft_consensus.cc:2468] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 1.
I20260807 07:56:06.404933 29248 leader_election.cc:290] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:06.405682 29275 raft_consensus.cc:515] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
W20260807 07:56:06.406404 29110 leader_election.cc:343] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:06.406478 29250 raft_consensus.cc:493] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.407704 29250 raft_consensus.cc:515] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.411590 29250 leader_election.cc:290] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:06.412818 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:06.413015 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:06.413551 29050 raft_consensus.cc:2468] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 0.
I20260807 07:56:06.413710 28941 raft_consensus.cc:3060] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.412928 28773 catalog_manager.cc:5697] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131). New cstate: current_term: 1 leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:06.414652 29110 leader_election.cc:304] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:06.415475 29275 leader_election.cc:290] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:06.415975 29248 raft_consensus.cc:2804] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:06.416364 29248 raft_consensus.cc:493] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:06.416728 29248 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.412895 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:06.418445 28942 raft_consensus.cc:2468] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 0.
I20260807 07:56:06.419015 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
W20260807 07:56:06.420158 29110 leader_election.cc:343] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:06.421766 29243 tablet_bootstrap.cc:492] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce: No bootstrap required, opened a new log
I20260807 07:56:06.422209 29243 ts_tablet_manager.cc:1403] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce: Time spent bootstrapping tablet: real 0.111s user 0.026s sys 0.050s
I20260807 07:56:06.425273 29243 raft_consensus.cc:359] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.425940 29243 raft_consensus.cc:385] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.426213 29243 raft_consensus.cc:740] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.427037 29243 consensus_queue.cc:260] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.427745 28941 raft_consensus.cc:2468] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 1.
I20260807 07:56:06.428960 29112 leader_election.cc:304] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 313fe8fb51e84e1ea251584f55792fce
I20260807 07:56:06.429337 29244 tablet_bootstrap.cc:492] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10: No bootstrap required, opened a new log
I20260807 07:56:06.429904 29244 ts_tablet_manager.cc:1403] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10: Time spent bootstrapping tablet: real 0.064s user 0.012s sys 0.005s
I20260807 07:56:06.430325 29275 raft_consensus.cc:2804] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:06.430369 29248 raft_consensus.cc:515] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.431224 29275 raft_consensus.cc:697] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Becoming Leader. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:06.433354 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:06.433943 28942 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.434589 29243 ts_tablet_manager.cc:1434] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260807 07:56:06.435475 29243 tablet_bootstrap.cc:492] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce: Bootstrap starting.
I20260807 07:56:06.434357 29275 consensus_queue.cc:237] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.432500 29248 leader_election.cc:290] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:06.432721 29244 raft_consensus.cc:359] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.438411 29244 raft_consensus.cc:385] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.435557 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:06.438808 29244 raft_consensus.cc:740] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.439271 29050 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.439769 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e6900e83d489b86a1417e4cd74169" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:06.439702 29244 consensus_queue.cc:260] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.441088 29243 tablet_bootstrap.cc:654] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce: Neither blocks nor log segments found. Creating new log.
W20260807 07:56:06.441438 29002 leader_election.cc:343] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:06.439231 29174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc7fe03092c42cba6694d2a11392e15" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
W20260807 07:56:06.443286 29002 leader_election.cc:343] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:06.447114 28942 raft_consensus.cc:2468] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 1.
I20260807 07:56:06.448670 29250 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.449095 29250 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.449563 29242 tablet_bootstrap.cc:492] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2: No bootstrap required, opened a new log
I20260807 07:56:06.450011 29242 ts_tablet_manager.cc:1403] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent bootstrapping tablet: real 0.077s user 0.004s sys 0.011s
I20260807 07:56:06.450691 29244 ts_tablet_manager.cc:1434] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260807 07:56:06.451390 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e6900e83d489b86a1417e4cd74169" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:06.452009 28939 raft_consensus.cc:2468] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 0.
I20260807 07:56:06.452590 29250 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:06.452451 29242 raft_consensus.cc:359] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.453092 29242 raft_consensus.cc:385] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.453316 29244 tablet_bootstrap.cc:492] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10: Bootstrap starting.
I20260807 07:56:06.453754 29001 leader_election.cc:304] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters: b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:06.457192 29174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:06.457816 29174 raft_consensus.cc:2468] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 0.
I20260807 07:56:06.458215 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:06.458941 29250 raft_consensus.cc:2804] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:06.459285 29250 raft_consensus.cc:493] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:06.459615 29250 raft_consensus.cc:3060] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.459997 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc7fe03092c42cba6694d2a11392e15" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:06.460377 29244 tablet_bootstrap.cc:654] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.461565 28941 raft_consensus.cc:2468] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 0.
I20260807 07:56:06.453763 29112 leader_election.cc:304] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:06.453372 29242 raft_consensus.cc:740] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.463138 29242 consensus_queue.cc:260] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.465031 29050 raft_consensus.cc:2468] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 1.
I20260807 07:56:06.465040 29242 ts_tablet_manager.cc:1434] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260807 07:56:06.471529 29242 tablet_bootstrap.cc:492] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2: Bootstrap starting.
I20260807 07:56:06.473548 28779 catalog_manager.cc:5697] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131). New cstate: current_term: 1 leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:06.475392 29242 tablet_bootstrap.cc:654] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2: Neither blocks nor log segments found. Creating new log.
W20260807 07:56:06.461686 29001 leader_election.cc:343] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:06.468215 29248 raft_consensus.cc:2804] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:06.480895 29248 raft_consensus.cc:697] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Becoming Leader. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:06.481060 29001 leader_election.cc:304] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters: b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:06.481775 29248 consensus_queue.cc:237] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.483318 29250 raft_consensus.cc:515] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.485487 29244 tablet_bootstrap.cc:492] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10: No bootstrap required, opened a new log
I20260807 07:56:06.485961 29244 ts_tablet_manager.cc:1403] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10: Time spent bootstrapping tablet: real 0.033s user 0.011s sys 0.007s
I20260807 07:56:06.488663 29244 raft_consensus.cc:359] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.489315 29244 raft_consensus.cc:385] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.489614 29244 raft_consensus.cc:740] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.490274 29244 consensus_queue.cc:260] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.492053 29302 raft_consensus.cc:493] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.492676 29002 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10
I20260807 07:56:06.492503 29302 raft_consensus.cc:515] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.494213 29251 raft_consensus.cc:493] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.493507 29250 leader_election.cc:290] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:06.494925 29250 raft_consensus.cc:2804] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:06.494774 29251 raft_consensus.cc:515] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.495262 29250 raft_consensus.cc:493] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:06.495582 29250 raft_consensus.cc:3060] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.496903 29244 ts_tablet_manager.cc:1434] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260807 07:56:06.497865 29244 tablet_bootstrap.cc:492] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10: Bootstrap starting.
I20260807 07:56:06.498440 29251 leader_election.cc:290] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:06.501005 29302 leader_election.cc:290] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:06.501549 29302 raft_consensus.cc:2804] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:06.501929 29302 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:06.502244 29302 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.512178 29275 raft_consensus.cc:493] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.513144 29275 raft_consensus.cc:515] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.516156 29275 leader_election.cc:290] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:06.551769 29250 raft_consensus.cc:515] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.551925 29302 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.543517 29248 raft_consensus.cc:493] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.542040 29275 raft_consensus.cc:493] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.559146 29302 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:06.562235 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:06.558014 29248 raft_consensus.cc:515] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.559533 29275 raft_consensus.cc:515] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.567408 29248 leader_election.cc:290] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:06.564934 28941 raft_consensus.cc:2468] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 0.
I20260807 07:56:06.557771 28773 catalog_manager.cc:5697] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131). New cstate: current_term: 1 leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:06.570235 29112 leader_election.cc:304] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:06.570990 29248 raft_consensus.cc:2804] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:06.571329 29248 raft_consensus.cc:493] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:06.571666 29248 raft_consensus.cc:3060] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.572218 29243 tablet_bootstrap.cc:492] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce: No bootstrap required, opened a new log
I20260807 07:56:06.572212 29244 tablet_bootstrap.cc:654] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.572932 29243 ts_tablet_manager.cc:1403] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce: Time spent bootstrapping tablet: real 0.138s user 0.043s sys 0.043s
I20260807 07:56:06.564276 29302 raft_consensus.cc:493] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:56:06.572276 29001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:42229, user_credentials={real_user=slave}} blocked reactor thread for 88482.2us
I20260807 07:56:06.574560 29302 raft_consensus.cc:515] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.576659 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e6900e83d489b86a1417e4cd74169" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:06.577307 28942 raft_consensus.cc:3060] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.577754 29302 leader_election.cc:290] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:06.569785 29250 leader_election.cc:290] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:06.578920 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a136c96874492cbf476b53d967403e" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:06.580406 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea4142012de4b6ea3550c5a9178a116" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:06.583125 28939 raft_consensus.cc:2468] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 0.
I20260807 07:56:06.583076 28938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea4142012de4b6ea3550c5a9178a116" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:06.583802 28938 raft_consensus.cc:2468] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 0.
I20260807 07:56:06.584296 29112 leader_election.cc:304] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:06.585505 29277 raft_consensus.cc:2804] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:06.585309 29275 leader_election.cc:290] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:06.589350 28938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:06.586329 29277 raft_consensus.cc:493] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:06.590919 29277 raft_consensus.cc:3060] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.594794 29001 leader_election.cc:304] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters:
I20260807 07:56:06.594915 28938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc7fe03092c42cba6694d2a11392e15" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:06.595263 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:06.595688 28938 raft_consensus.cc:3060] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.579952 28941 raft_consensus.cc:2468] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 0.
I20260807 07:56:06.595870 28939 raft_consensus.cc:2468] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 0.
W20260807 07:56:06.579448 29002 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:42527, user_credentials={real_user=slave}} blocked reactor thread for 86851.3us
I20260807 07:56:06.599627 29314 raft_consensus.cc:2804] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:06.600075 29314 raft_consensus.cc:493] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:06.600421 29314 raft_consensus.cc:3060] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Advancing to term 1
W20260807 07:56:06.595844 29001 leader_election.cc:343] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:06.602945 29001 leader_election.cc:304] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters:
I20260807 07:56:06.601243 29112 leader_election.cc:304] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:06.605011 29309 raft_consensus.cc:2804] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:06.607939 29309 raft_consensus.cc:493] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:06.609246 29309 raft_consensus.cc:3060] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.609762 29174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e6900e83d489b86a1417e4cd74169" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:06.611063 29174 raft_consensus.cc:3060] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.607470 29275 raft_consensus.cc:2804] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:06.617558 29243 raft_consensus.cc:359] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.618093 29243 raft_consensus.cc:385] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.618315 29243 raft_consensus.cc:740] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.619249 29242 tablet_bootstrap.cc:492] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2: No bootstrap required, opened a new log
I20260807 07:56:06.619620 29242 ts_tablet_manager.cc:1403] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent bootstrapping tablet: real 0.148s user 0.008s sys 0.005s
I20260807 07:56:06.614668 29275 raft_consensus.cc:493] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:06.625079 29243 consensus_queue.cc:260] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.623728 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea4142012de4b6ea3550c5a9178a116" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:06.628571 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:06.629217 29172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:06.630611 29174 raft_consensus.cc:2468] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 1.
I20260807 07:56:06.624167 29275 raft_consensus.cc:3060] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.634575 29244 tablet_bootstrap.cc:492] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10: No bootstrap required, opened a new log
I20260807 07:56:06.634974 29174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:06.635033 29277 raft_consensus.cc:515] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.637828 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:06.640518 29173 raft_consensus.cc:2393] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 313fe8fb51e84e1ea251584f55792fce in current term 1: Already voted for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in this term.
I20260807 07:56:06.638777 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a136c96874492cbf476b53d967403e" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:06.641170 29243 ts_tablet_manager.cc:1434] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce: Time spent starting tablet: real 0.068s user 0.003s sys 0.003s
I20260807 07:56:06.641449 29045 raft_consensus.cc:2468] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 0.
I20260807 07:56:06.642169 29277 leader_election.cc:290] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:06.637337 29244 ts_tablet_manager.cc:1403] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10: Time spent bootstrapping tablet: real 0.140s user 0.028s sys 0.006s
I20260807 07:56:06.648222 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea4142012de4b6ea3550c5a9178a116" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:06.639933 29174 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.637313 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc7fe03092c42cba6694d2a11392e15" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:06.649323 29002 leader_election.cc:304] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:06.640079 29168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:06.642458 28942 raft_consensus.cc:2468] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 1.
I20260807 07:56:06.644652 29309 raft_consensus.cc:515] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.647212 29248 raft_consensus.cc:515] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.647352 29275 raft_consensus.cc:515] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.638681 29314 raft_consensus.cc:515] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.649513 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea4142012de4b6ea3550c5a9178a116" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:06.653242 28939 raft_consensus.cc:3060] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.651400 29250 raft_consensus.cc:2804] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:06.655622 29172 raft_consensus.cc:2393] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06730445eab14c99872e29a97027bf10 in current term 1: Already voted for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in this term.
I20260807 07:56:06.656924 29309 leader_election.cc:290] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:06.659710 29045 raft_consensus.cc:2393] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in current term 1: Already voted for candidate 313fe8fb51e84e1ea251584f55792fce in this term.
I20260807 07:56:06.659715 29275 leader_election.cc:290] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:06.654837 29250 raft_consensus.cc:697] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Becoming Leader. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:06.661908 29174 raft_consensus.cc:2468] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 1.
I20260807 07:56:06.662062 29250 consensus_queue.cc:237] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.654867 29050 raft_consensus.cc:2393] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06730445eab14c99872e29a97027bf10 in current term 1: Already voted for candidate 313fe8fb51e84e1ea251584f55792fce in this term.
I20260807 07:56:06.665560 29248 leader_election.cc:290] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:06.666683 28939 raft_consensus.cc:2468] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 1.
I20260807 07:56:06.666769 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea4142012de4b6ea3550c5a9178a116" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:06.668490 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a136c96874492cbf476b53d967403e" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:06.668754 29050 raft_consensus.cc:2393] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in current term 1: Already voted for candidate 313fe8fb51e84e1ea251584f55792fce in this term.
I20260807 07:56:06.669523 29045 raft_consensus.cc:3060] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.669739 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:06.670403 28895 leader_election.cc:304] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06730445eab14c99872e29a97027bf10; no voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:06.671763 28938 raft_consensus.cc:2468] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 1.
I20260807 07:56:06.674203 29001 leader_election.cc:304] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters:
I20260807 07:56:06.674499 29002 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10
I20260807 07:56:06.675514 29250 raft_consensus.cc:2804] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:06.675999 29250 raft_consensus.cc:697] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Becoming Leader. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:06.676136 29302 raft_consensus.cc:2804] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:06.676860 29250 consensus_queue.cc:237] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.677651 28773 catalog_manager.cc:5697] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce reported cstate change: term changed from 0 to 1, leader changed from <none> to 313fe8fb51e84e1ea251584f55792fce (127.27.64.130). New cstate: current_term: 1 leader_uuid: "313fe8fb51e84e1ea251584f55792fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:06.679005 29045 raft_consensus.cc:2468] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 1.
I20260807 07:56:06.671415 28942 raft_consensus.cc:3060] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.684297 29112 leader_election.cc:304] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 313fe8fb51e84e1ea251584f55792fce
I20260807 07:56:06.686640 29314 leader_election.cc:290] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:06.682868 29110 leader_election.cc:304] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:06.687708 29172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea4142012de4b6ea3550c5a9178a116" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:06.685240 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a136c96874492cbf476b53d967403e" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:06.688472 29275 raft_consensus.cc:2804] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:06.689349 29277 raft_consensus.cc:2804] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:06.680832 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:06.690187 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea4142012de4b6ea3550c5a9178a116" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:06.690601 29050 raft_consensus.cc:2393] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in current term 1: Already voted for candidate 313fe8fb51e84e1ea251584f55792fce in this term.
I20260807 07:56:06.690912 28941 raft_consensus.cc:2393] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 313fe8fb51e84e1ea251584f55792fce in current term 1: Already voted for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in this term.
I20260807 07:56:06.680568 29174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:06.690155 29275 raft_consensus.cc:697] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Becoming Leader. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:06.692370 29174 raft_consensus.cc:2393] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 313fe8fb51e84e1ea251584f55792fce in current term 1: Already voted for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in this term.
I20260807 07:56:06.683790 29244 raft_consensus.cc:359] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.693763 29244 raft_consensus.cc:385] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.694038 29244 raft_consensus.cc:740] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.692955 29275 consensus_queue.cc:237] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.684953 28938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:06.696467 29244 consensus_queue.cc:260] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.698678 29110 leader_election.cc:304] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce
I20260807 07:56:06.699595 29322 raft_consensus.cc:2749] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 07:56:06.688630 28939 raft_consensus.cc:3060] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.700181 28942 raft_consensus.cc:2468] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 1.
I20260807 07:56:06.700637 29251 raft_consensus.cc:2749] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:06.701320 29322 consensus_queue.cc:1048] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:06.706318 29244 ts_tablet_manager.cc:1434] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10: Time spent starting tablet: real 0.058s user 0.009s sys 0.000s
I20260807 07:56:06.707307 29244 tablet_bootstrap.cc:492] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10: Bootstrap starting.
I20260807 07:56:06.707134 29001 leader_election.cc:304] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters: b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:06.683671 29242 raft_consensus.cc:359] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.708021 29242 raft_consensus.cc:385] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.708352 29314 raft_consensus.cc:2804] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:06.708442 29242 raft_consensus.cc:740] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.709112 29314 raft_consensus.cc:697] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Becoming Leader. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:06.709338 29242 consensus_queue.cc:260] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.710525 29170 raft_consensus.cc:3060] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.710374 29314 consensus_queue.cc:237] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.713802 29244 tablet_bootstrap.cc:654] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:06.717864 29170 raft_consensus.cc:2468] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 1.
I20260807 07:56:06.719739 29277 raft_consensus.cc:697] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Becoming Leader. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:06.720744 29277 consensus_queue.cc:237] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.721347 28939 raft_consensus.cc:2468] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 1.
W20260807 07:56:06.727392 29112 consensus_peers.cc:597] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 -> Peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Couldn't send request to peer 06730445eab14c99872e29a97027bf10. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:06.728900 29244 tablet_bootstrap.cc:492] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10: No bootstrap required, opened a new log
I20260807 07:56:06.733407 29302 raft_consensus.cc:697] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Becoming Leader. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:06.733476 29002 leader_election.cc:304] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce; no voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:06.734704 28773 catalog_manager.cc:5697] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131). New cstate: current_term: 1 leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:06.736640 29244 ts_tablet_manager.cc:1403] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.006s
I20260807 07:56:06.734592 29302 consensus_queue.cc:237] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.738977 29244 raft_consensus.cc:359] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.739591 29244 raft_consensus.cc:385] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:06.739851 29244 raft_consensus.cc:740] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Initialized, Role: FOLLOWER
I20260807 07:56:06.742101 29242 ts_tablet_manager.cc:1434] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2: Time spent starting tablet: real 0.122s user 0.006s sys 0.001s
I20260807 07:56:06.742923 29244 consensus_queue.cc:260] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.747603 29319 raft_consensus.cc:2749] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 07:56:06.747123 29244 ts_tablet_manager.cc:1434] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260807 07:56:06.757320 29323 raft_consensus.cc:493] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.757817 29323 raft_consensus.cc:515] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.759976 29323 leader_election.cc:290] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:06.759850 28773 catalog_manager.cc:5697] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131). New cstate: current_term: 1 leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:06.760963 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:06.761670 29172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:06.765554 28895 leader_election.cc:304] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06730445eab14c99872e29a97027bf10; no voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:06.766765 29323 raft_consensus.cc:2749] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:06.770557 28779 catalog_manager.cc:5697] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce reported cstate change: term changed from 0 to 1, leader changed from <none> to 313fe8fb51e84e1ea251584f55792fce (127.27.64.130). New cstate: current_term: 1 leader_uuid: "313fe8fb51e84e1ea251584f55792fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:06.771925 28779 catalog_manager.cc:5697] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce reported cstate change: term changed from 0 to 1, leader changed from <none> to 313fe8fb51e84e1ea251584f55792fce (127.27.64.130). New cstate: current_term: 1 leader_uuid: "313fe8fb51e84e1ea251584f55792fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:06.784257 28779 catalog_manager.cc:5697] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce reported cstate change: term changed from 0 to 1, leader changed from <none> to 313fe8fb51e84e1ea251584f55792fce (127.27.64.130). New cstate: current_term: 1 leader_uuid: "313fe8fb51e84e1ea251584f55792fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:06.806589 29277 consensus_queue.cc:1048] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:06.818380 29320 consensus_queue.cc:1048] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:06.872166 29302 raft_consensus.cc:493] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:06.872586 29302 raft_consensus.cc:515] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:06.874213 29302 leader_election.cc:290] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:06.875038 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:06.875325 29172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:06.875847 28939 raft_consensus.cc:2393] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 313fe8fb51e84e1ea251584f55792fce in current term 1: Already voted for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in this term.
I20260807 07:56:06.876777 29001 leader_election.cc:304] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce; no voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:06.877369 29302 raft_consensus.cc:3060] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:06.881798 29302 raft_consensus.cc:2749] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:06.898097 29320 consensus_queue.cc:1048] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:06.907950 29322 consensus_queue.cc:1048] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:06.984633 29248 consensus_queue.cc:1048] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:06.994352 29172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6901eb624c64f168d9b8e6668309d5d"
dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
mode: GRACEFUL
new_leader_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:47748
I20260807 07:56:06.995630 29172 raft_consensus.cc:606] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Received request to transfer leadership to TS 06730445eab14c99872e29a97027bf10
I20260807 07:56:06.996851 29277 consensus_queue.cc:1048] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:07.001771 29172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e"
dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
mode: GRACEFUL
new_leader_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:47748
I20260807 07:56:07.002318 29172 raft_consensus.cc:606] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Received request to transfer leadership to TS 06730445eab14c99872e29a97027bf10
I20260807 07:56:07.016016 29050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "417e6900e83d489b86a1417e4cd74169"
dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
mode: GRACEFUL
new_leader_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:36960
I20260807 07:56:07.016508 29050 raft_consensus.cc:606] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Received request to transfer leadership to TS 06730445eab14c99872e29a97027bf10
I20260807 07:56:07.021216 29050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5"
dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
mode: GRACEFUL
new_leader_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:36960
I20260807 07:56:07.021792 29050 raft_consensus.cc:606] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Received request to transfer leadership to TS 06730445eab14c99872e29a97027bf10
I20260807 07:56:07.026445 29172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f"
dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
mode: GRACEFUL
new_leader_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:47748
I20260807 07:56:07.026880 29172 raft_consensus.cc:606] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Received request to transfer leadership to TS 06730445eab14c99872e29a97027bf10
I20260807 07:56:07.036373 29172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a"
dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
mode: GRACEFUL
new_leader_uuid: "313fe8fb51e84e1ea251584f55792fce"
from {username='slave'} at 127.0.0.1:47748
I20260807 07:56:07.036808 29172 raft_consensus.cc:606] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Received request to transfer leadership to TS 313fe8fb51e84e1ea251584f55792fce
I20260807 07:56:07.041218 29172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26a136c96874492cbf476b53d967403e"
dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
mode: GRACEFUL
new_leader_uuid: "313fe8fb51e84e1ea251584f55792fce"
from {username='slave'} at 127.0.0.1:47748
I20260807 07:56:07.041697 29172 raft_consensus.cc:606] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Received request to transfer leadership to TS 313fe8fb51e84e1ea251584f55792fce
I20260807 07:56:07.064224 29302 consensus_queue.cc:1048] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:07.074859 29319 consensus_queue.cc:1048] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:07.088937 29319 consensus_queue.cc:1048] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:07.097317 29277 consensus_queue.cc:1048] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:07.101066 29319 consensus_queue.cc:1048] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:07.110307 29320 consensus_queue.cc:1048] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:07.112583 29319 raft_consensus.cc:993] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce: : Instructing follower 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:07.113103 29319 raft_consensus.cc:1081] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Signalling peer 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:07.116488 28942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "417e6900e83d489b86a1417e4cd74169"
dest_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:46464
I20260807 07:56:07.117112 28942 raft_consensus.cc:493] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:07.117498 28942 raft_consensus.cc:3060] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.123260 28942 raft_consensus.cc:515] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.125559 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e6900e83d489b86a1417e4cd74169" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:07.126374 29172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e6900e83d489b86a1417e4cd74169" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:07.126195 28942 leader_election.cc:290] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Requested vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:07.126917 29172 raft_consensus.cc:3060] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.129751 29050 raft_consensus.cc:3055] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:56:07.130123 29050 raft_consensus.cc:740] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:07.130780 29050 consensus_queue.cc:260] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.131808 29050 raft_consensus.cc:3060] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.133154 29172 raft_consensus.cc:2468] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 2.
I20260807 07:56:07.134342 28895 leader_election.cc:304] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:07.135206 29323 raft_consensus.cc:2804] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:56:07.135625 29323 raft_consensus.cc:697] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Becoming Leader. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:07.136338 29323 consensus_queue.cc:237] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.137255 29050 raft_consensus.cc:2468] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 2.
I20260807 07:56:07.142915 28773 catalog_manager.cc:5697] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 reported cstate change: term changed from 1 to 2, leader changed from 313fe8fb51e84e1ea251584f55792fce (127.27.64.130) to 06730445eab14c99872e29a97027bf10 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "06730445eab14c99872e29a97027bf10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:07.147321 29323 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:07.147763 29323 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.150157 29323 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:07.150415 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:07.150836 29172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:07.151556 29172 raft_consensus.cc:2393] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06730445eab14c99872e29a97027bf10 in current term 1: Already voted for candidate 313fe8fb51e84e1ea251584f55792fce in this term.
I20260807 07:56:07.152364 28895 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06730445eab14c99872e29a97027bf10; no voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:07.152968 29323 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:07.157918 29323 raft_consensus.cc:2749] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:07.162556 29320 consensus_queue.cc:1048] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:07.172928 29320 consensus_queue.cc:1048] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:07.180220 29275 raft_consensus.cc:993] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2: : Instructing follower 313fe8fb51e84e1ea251584f55792fce to start an election
I20260807 07:56:07.180632 29320 raft_consensus.cc:1081] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Signalling peer 313fe8fb51e84e1ea251584f55792fce to start an election
I20260807 07:56:07.182093 29050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26a136c96874492cbf476b53d967403e"
dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
from {username='slave'} at 127.0.0.1:36942
I20260807 07:56:07.182539 29050 raft_consensus.cc:493] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:07.182837 29050 raft_consensus.cc:3060] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.187374 29050 raft_consensus.cc:515] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.188894 29050 leader_election.cc:290] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 2 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:07.189920 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a136c96874492cbf476b53d967403e" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:07.190053 29172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a136c96874492cbf476b53d967403e" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:07.190560 28942 raft_consensus.cc:3060] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.190599 29172 raft_consensus.cc:3055] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:56:07.191085 29172 raft_consensus.cc:740] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:07.191912 29172 consensus_queue.cc:260] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.193138 29172 raft_consensus.cc:3060] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.197343 28942 raft_consensus.cc:2468] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 2.
I20260807 07:56:07.198612 29001 leader_election.cc:304] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters:
I20260807 07:56:07.199335 29172 raft_consensus.cc:2468] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 2.
I20260807 07:56:07.199525 29319 raft_consensus.cc:2804] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:56:07.200052 29319 raft_consensus.cc:697] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [term 2 LEADER]: Becoming Leader. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:07.200778 29319 consensus_queue.cc:237] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.206977 28779 catalog_manager.cc:5697] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce reported cstate change: term changed from 1 to 2, leader changed from b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131) to 313fe8fb51e84e1ea251584f55792fce (127.27.64.130). New cstate: current_term: 2 leader_uuid: "313fe8fb51e84e1ea251584f55792fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:07.256482 29319 consensus_queue.cc:1048] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:07.263257 29314 raft_consensus.cc:993] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce: : Instructing follower 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:07.263765 29309 raft_consensus.cc:1081] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Signalling peer 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:07.265532 28939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5"
dest_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:46464
I20260807 07:56:07.266121 28939 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:07.266494 28939 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.271310 29309 consensus_queue.cc:1048] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:07.273020 28939 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.275879 28939 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Requested vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:07.276095 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:07.276171 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:07.277715 29050 raft_consensus.cc:3055] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:56:07.279599 29050 raft_consensus.cc:740] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:07.280422 29050 consensus_queue.cc:260] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.281531 29050 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.283828 28939 raft_consensus.cc:3060] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:07.286433 29309 consensus_queue.cc:1048] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:07.287454 29050 raft_consensus.cc:2468] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 2.
I20260807 07:56:07.288437 28890 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters: b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:07.289229 29323 raft_consensus.cc:2804] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:56:07.289717 29323 raft_consensus.cc:697] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Becoming Leader. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:07.290498 29323 consensus_queue.cc:237] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.299738 29248 raft_consensus.cc:993] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2: : Instructing follower 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:07.300204 29320 raft_consensus.cc:1081] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Signalling peer 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:07.302165 28942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f"
dest_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:46462
I20260807 07:56:07.302821 28942 raft_consensus.cc:493] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:07.303244 28942 raft_consensus.cc:3060] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.303489 28773 catalog_manager.cc:5697] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 reported cstate change: term changed from 1 to 2, leader changed from 313fe8fb51e84e1ea251584f55792fce (127.27.64.130) to 06730445eab14c99872e29a97027bf10 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "06730445eab14c99872e29a97027bf10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:07.306082 29250 consensus_queue.cc:1048] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:07.310635 28942 raft_consensus.cc:515] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.313580 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:07.314157 29050 raft_consensus.cc:3060] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.314641 28942 leader_election.cc:290] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Requested vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:07.317096 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:07.317690 29170 raft_consensus.cc:3055] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:56:07.318006 29170 raft_consensus.cc:740] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:07.318799 29170 consensus_queue.cc:260] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.322602 29050 raft_consensus.cc:2468] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 2.
I20260807 07:56:07.324474 28890 leader_election.cc:304] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters:
I20260807 07:56:07.325284 29045 raft_consensus.cc:1240] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Rejecting Update request from peer b9228a7f7f1f4ff984e6bdbc480fecc2 for earlier term 1. Current term is 2. Ops: []
I20260807 07:56:07.325306 29323 raft_consensus.cc:2804] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:56:07.325973 29323 raft_consensus.cc:697] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Becoming Leader. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:07.327117 29170 raft_consensus.cc:3060] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.326809 29323 consensus_queue.cc:237] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.333875 29170 raft_consensus.cc:2468] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 2.
I20260807 07:56:07.335927 28773 catalog_manager.cc:5697] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 reported cstate change: term changed from 1 to 2, leader changed from b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131) to 06730445eab14c99872e29a97027bf10 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "06730445eab14c99872e29a97027bf10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:07.341401 29320 raft_consensus.cc:993] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2: : Instructing follower 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:07.341920 29275 raft_consensus.cc:1081] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Signalling peer 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:07.343870 28942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e"
dest_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:46462
I20260807 07:56:07.344400 28942 raft_consensus.cc:493] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:07.344738 28942 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.349215 28942 raft_consensus.cc:515] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.350919 28942 leader_election.cc:290] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Requested vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:07.351854 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:07.352037 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:07.352458 29045 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.352582 29170 raft_consensus.cc:3055] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:56:07.352958 29170 raft_consensus.cc:740] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:07.353127 29320 raft_consensus.cc:993] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2: : Instructing follower 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:07.353585 29275 raft_consensus.cc:1081] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Signalling peer 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:07.353907 29170 consensus_queue.cc:260] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.354961 29170 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.355337 28939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6901eb624c64f168d9b8e6668309d5d"
dest_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:46462
I20260807 07:56:07.355878 28939 raft_consensus.cc:493] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:07.356242 28939 raft_consensus.cc:3060] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.358124 29045 raft_consensus.cc:2468] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 2.
I20260807 07:56:07.359169 28890 leader_election.cc:304] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters:
I20260807 07:56:07.359802 29323 raft_consensus.cc:2804] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:56:07.360179 29323 raft_consensus.cc:697] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Becoming Leader. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:07.360869 29323 consensus_queue.cc:237] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.361497 29170 raft_consensus.cc:2468] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 2.
I20260807 07:56:07.363076 28939 raft_consensus.cc:515] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:07.364876 28939 leader_election.cc:290] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Requested vote from peers b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:07.365702 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6901eb624c64f168d9b8e6668309d5d" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:07.366237 29170 raft_consensus.cc:3055] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:56:07.366460 29170 raft_consensus.cc:740] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:07.367122 29170 consensus_queue.cc:260] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:07.367671 28779 catalog_manager.cc:5697] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 reported cstate change: term changed from 1 to 2, leader changed from b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131) to 06730445eab14c99872e29a97027bf10 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "06730445eab14c99872e29a97027bf10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:07.368330 29170 raft_consensus.cc:3060] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.370067 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6901eb624c64f168d9b8e6668309d5d" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:07.370626 29045 raft_consensus.cc:3060] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.374790 29170 raft_consensus.cc:2468] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 2.
I20260807 07:56:07.376852 29045 raft_consensus.cc:2468] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 2.
I20260807 07:56:07.378011 28890 leader_election.cc:304] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters:
I20260807 07:56:07.378708 29323 raft_consensus.cc:2804] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:56:07.379142 29323 raft_consensus.cc:697] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Becoming Leader. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:07.379802 29323 consensus_queue.cc:237] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:07.385561 28779 catalog_manager.cc:5697] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 reported cstate change: term changed from 1 to 2, leader changed from b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131) to 06730445eab14c99872e29a97027bf10 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "06730445eab14c99872e29a97027bf10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:07.459067 29320 raft_consensus.cc:993] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2: : Instructing follower 313fe8fb51e84e1ea251584f55792fce to start an election
I20260807 07:56:07.459507 29275 raft_consensus.cc:1081] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Signalling peer 313fe8fb51e84e1ea251584f55792fce to start an election
I20260807 07:56:07.460841 29045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a"
dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
from {username='slave'} at 127.0.0.1:36942
I20260807 07:56:07.461263 29045 raft_consensus.cc:493] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:07.461530 29045 raft_consensus.cc:3060] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.465970 29045 raft_consensus.cc:515] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.467478 29045 leader_election.cc:290] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 2 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:07.468254 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:07.468523 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:07.468837 28939 raft_consensus.cc:3060] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.469069 29170 raft_consensus.cc:3055] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:56:07.469424 29170 raft_consensus.cc:740] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:07.470206 29170 consensus_queue.cc:260] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.471408 29170 raft_consensus.cc:3060] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.475214 28939 raft_consensus.cc:2468] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 2.
I20260807 07:56:07.476424 29001 leader_election.cc:304] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters:
I20260807 07:56:07.477082 29250 raft_consensus.cc:2804] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:56:07.477427 29170 raft_consensus.cc:2468] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 2.
I20260807 07:56:07.477591 29250 raft_consensus.cc:697] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 2 LEADER]: Becoming Leader. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:07.478380 29250 consensus_queue.cc:237] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:07.484319 28779 catalog_manager.cc:5697] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce reported cstate change: term changed from 1 to 2, leader changed from b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131) to 313fe8fb51e84e1ea251584f55792fce (127.27.64.130). New cstate: current_term: 2 leader_uuid: "313fe8fb51e84e1ea251584f55792fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:07.613231 28939 raft_consensus.cc:1275] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Refusing update from remote peer 313fe8fb51e84e1ea251584f55792fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.614513 29250 consensus_queue.cc:1048] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:07.621847 29170 raft_consensus.cc:1275] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Refusing update from remote peer 313fe8fb51e84e1ea251584f55792fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.623591 29319 consensus_queue.cc:1048] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:07.669204 29045 raft_consensus.cc:1275] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.670594 29323 consensus_queue.cc:1048] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:07.678020 29170 raft_consensus.cc:1275] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.680193 29366 consensus_queue.cc:1048] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:07.803660 29170 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:07.808631 29170 raft_consensus.cc:1275] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.809845 29323 consensus_queue.cc:1048] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:07.818199 29045 raft_consensus.cc:1275] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.819672 29366 consensus_queue.cc:1048] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:07.851263 29170 raft_consensus.cc:1275] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.852487 29366 consensus_queue.cc:1048] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:07.862357 29045 raft_consensus.cc:1275] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.863829 29251 consensus_queue.cc:1048] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:07.875519 29045 raft_consensus.cc:1275] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.876667 29323 consensus_queue.cc:1048] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:07.877853 29170 raft_consensus.cc:1275] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.879066 29323 consensus_queue.cc:1048] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:07.897091 28939 raft_consensus.cc:1275] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Refusing update from remote peer 313fe8fb51e84e1ea251584f55792fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.898690 29319 consensus_queue.cc:1048] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:07.905534 29170 raft_consensus.cc:1275] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Refusing update from remote peer 313fe8fb51e84e1ea251584f55792fce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.907349 29250 consensus_queue.cc:1048] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:07.919257 29045 raft_consensus.cc:1275] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.920405 29323 consensus_queue.cc:1048] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:07.924208 29170 raft_consensus.cc:1275] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:07.925658 29323 consensus_queue.cc:1048] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:10.075951 27906 auto_leader_rebalancer-test.cc:473] The leader distribution is
I20260807 07:56:10.076599 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:10.096454 28939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e"
dest_uuid: "06730445eab14c99872e29a97027bf10"
mode: GRACEFUL
new_leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
from {username='slave'} at 127.0.0.1:46468
I20260807 07:56:10.097002 28939 raft_consensus.cc:606] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Received request to transfer leadership to TS b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:10.099440 28939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5"
dest_uuid: "06730445eab14c99872e29a97027bf10"
mode: GRACEFUL
new_leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
from {username='slave'} at 127.0.0.1:46468
I20260807 07:56:10.099912 28939 raft_consensus.cc:606] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Received request to transfer leadership to TS b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:10.100966 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 07:56:10.101449 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:10.304437 29323 raft_consensus.cc:993] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10: : Instructing follower b9228a7f7f1f4ff984e6bdbc480fecc2 to start an election
I20260807 07:56:10.304903 29381 raft_consensus.cc:1081] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Signalling peer b9228a7f7f1f4ff984e6bdbc480fecc2 to start an election
I20260807 07:56:10.306365 29170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e"
dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
from {username='slave'} at 127.0.0.1:47742
I20260807 07:56:10.306816 29170 raft_consensus.cc:493] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:10.307092 29170 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:10.311731 29170 raft_consensus.cc:515] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:10.313177 29170 leader_election.cc:290] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:10.314090 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:10.314294 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:10.314695 28939 raft_consensus.cc:3055] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:56:10.314785 29045 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:10.315053 28939 raft_consensus.cc:740] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:10.315857 28939 consensus_queue.cc:260] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:10.317152 28939 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:10.321408 29045 raft_consensus.cc:2468] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 3.
I20260807 07:56:10.322682 29110 leader_election.cc:304] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:10.323362 29379 raft_consensus.cc:2804] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:56:10.323303 28939 raft_consensus.cc:2468] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 3.
I20260807 07:56:10.324476 29379 raft_consensus.cc:697] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Becoming Leader. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:10.325249 29379 consensus_queue.cc:237] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:10.332156 28778 catalog_manager.cc:5697] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 reported cstate change: term changed from 2 to 3, leader changed from 06730445eab14c99872e29a97027bf10 (127.27.64.129) to b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131). New cstate: current_term: 3 leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:10.576889 29323 raft_consensus.cc:993] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10: : Instructing follower b9228a7f7f1f4ff984e6bdbc480fecc2 to start an election
I20260807 07:56:10.577304 29381 raft_consensus.cc:1081] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Signalling peer b9228a7f7f1f4ff984e6bdbc480fecc2 to start an election
I20260807 07:56:10.578725 29170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5"
dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
from {username='slave'} at 127.0.0.1:47742
I20260807 07:56:10.579149 29170 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:10.579391 29170 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:10.583563 29170 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:10.584966 29170 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:10.585806 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:10.586206 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:10.586380 28939 raft_consensus.cc:3055] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:56:10.586716 28939 raft_consensus.cc:740] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:10.586751 29045 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:10.587584 28939 consensus_queue.cc:260] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:10.588816 28939 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:10.593663 29045 raft_consensus.cc:2468] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 3.
I20260807 07:56:10.594843 29110 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:10.595000 28939 raft_consensus.cc:2468] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 3.
I20260807 07:56:10.595566 29379 raft_consensus.cc:2804] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:56:10.596014 29379 raft_consensus.cc:697] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Becoming Leader. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:10.597071 29379 consensus_queue.cc:237] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:10.604669 28778 catalog_manager.cc:5697] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 reported cstate change: term changed from 2 to 3, leader changed from 06730445eab14c99872e29a97027bf10 (127.27.64.129) to b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131). New cstate: current_term: 3 leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:10.855460 29045 raft_consensus.cc:1275] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Refusing update from remote peer b9228a7f7f1f4ff984e6bdbc480fecc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:56:10.856689 29379 consensus_queue.cc:1048] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:10.866431 28939 raft_consensus.cc:1275] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Refusing update from remote peer b9228a7f7f1f4ff984e6bdbc480fecc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:56:10.867971 29379 consensus_queue.cc:1048] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:11.056519 29045 raft_consensus.cc:1275] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Refusing update from remote peer b9228a7f7f1f4ff984e6bdbc480fecc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:56:11.058049 29379 consensus_queue.cc:1048] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:11.069473 28939 raft_consensus.cc:1275] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Refusing update from remote peer b9228a7f7f1f4ff984e6bdbc480fecc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:56:11.073354 29406 consensus_queue.cc:1048] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:11.102334 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:11.107568 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:11.108029 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:12.108924 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:12.114228 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:12.114655 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:13.115914 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:13.122709 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:13.123133 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:14.124291 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:14.130702 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:14.131143 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:15.132138 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:15.137295 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:15.137748 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:16.138744 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:16.144264 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:16.144747 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:17.145797 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:17.151209 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:17.151645 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:18.152527 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:18.160115 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:18.160651 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:19.161681 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:19.167444 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:19.167877 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:20.196592 27906 auto_leader_rebalancer-test.cc:492] The leader distribution is
I20260807 07:56:20.203197 29170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e"
dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
mode: GRACEFUL
new_leader_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:47748
I20260807 07:56:20.203801 29170 raft_consensus.cc:606] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Received request to transfer leadership to TS 06730445eab14c99872e29a97027bf10
I20260807 07:56:20.210876 29170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5"
dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
mode: GRACEFUL
new_leader_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:47748
I20260807 07:56:20.211319 29170 raft_consensus.cc:606] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Received request to transfer leadership to TS 06730445eab14c99872e29a97027bf10
I20260807 07:56:20.218238 29050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6"
dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
mode: GRACEFUL
new_leader_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:36960
I20260807 07:56:20.218787 29050 raft_consensus.cc:606] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Received request to transfer leadership to TS 06730445eab14c99872e29a97027bf10
I20260807 07:56:20.223091 29050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dc7fe03092c42cba6694d2a11392e15"
dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
mode: GRACEFUL
new_leader_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:36960
I20260807 07:56:20.223480 29050 raft_consensus.cc:606] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Received request to transfer leadership to TS 06730445eab14c99872e29a97027bf10
I20260807 07:56:20.227670 29050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a"
dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
mode: GRACEFUL
new_leader_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:36960
I20260807 07:56:20.228072 29050 raft_consensus.cc:606] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 2 LEADER]: Received request to transfer leadership to TS 06730445eab14c99872e29a97027bf10
I20260807 07:56:20.234737 29417 raft_consensus.cc:993] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2: : Instructing follower 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:20.235204 29420 raft_consensus.cc:1081] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Signalling peer 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:20.236608 28939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e"
dest_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:46462
I20260807 07:56:20.237032 28939 raft_consensus.cc:493] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:20.237339 28939 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:56:20.241026 29419 raft_consensus.cc:993] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce: : Instructing follower 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:20.241604 29412 raft_consensus.cc:1081] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Signalling peer 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:20.242774 28939 raft_consensus.cc:515] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.243088 28942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dc7fe03092c42cba6694d2a11392e15"
dest_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:46464
I20260807 07:56:20.243528 28942 raft_consensus.cc:493] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:20.243829 28942 raft_consensus.cc:3060] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:20.244534 28939 leader_election.cc:290] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 4 election: Requested vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:20.245288 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:20.245594 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:20.246026 29050 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:56:20.246441 29170 raft_consensus.cc:3055] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:56:20.246685 29170 raft_consensus.cc:740] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:20.247355 29170 consensus_queue.cc:260] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.248353 29170 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:56:20.250317 28942 raft_consensus.cc:515] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.252169 28942 leader_election.cc:290] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Requested vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:20.253110 29172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc7fe03092c42cba6694d2a11392e15" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:20.253268 29050 raft_consensus.cc:2468] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 4.
I20260807 07:56:20.253074 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc7fe03092c42cba6694d2a11392e15" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:20.253726 29172 raft_consensus.cc:3060] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:20.253868 29045 raft_consensus.cc:3055] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:56:20.253975 29170 raft_consensus.cc:2468] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 4.
I20260807 07:56:20.254357 29045 raft_consensus.cc:740] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:20.254787 28890 leader_election.cc:304] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters:
I20260807 07:56:20.255167 29045 consensus_queue.cc:260] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.255975 29381 raft_consensus.cc:2804] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:56:20.256435 29045 raft_consensus.cc:3060] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:20.258015 29381 raft_consensus.cc:697] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 4 LEADER]: Becoming Leader. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:20.258935 29381 consensus_queue.cc:237] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.260962 29172 raft_consensus.cc:2468] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 2.
I20260807 07:56:20.261551 29045 raft_consensus.cc:2468] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 2.
I20260807 07:56:20.262223 28895 leader_election.cc:304] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:20.264484 29421 raft_consensus.cc:2804] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:56:20.266433 29421 raft_consensus.cc:697] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Becoming Leader. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:20.267416 29421 consensus_queue.cc:237] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.268806 28778 catalog_manager.cc:5697] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 reported cstate change: term changed from 3 to 4, leader changed from b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131) to 06730445eab14c99872e29a97027bf10 (127.27.64.129). New cstate: current_term: 4 leader_uuid: "06730445eab14c99872e29a97027bf10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:20.284943 28778 catalog_manager.cc:5697] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 reported cstate change: term changed from 1 to 2, leader changed from 313fe8fb51e84e1ea251584f55792fce (127.27.64.130) to 06730445eab14c99872e29a97027bf10 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "06730445eab14c99872e29a97027bf10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:20.319552 29417 raft_consensus.cc:993] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2: : Instructing follower 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:20.319991 29420 raft_consensus.cc:1081] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Signalling peer 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:20.321354 28942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5"
dest_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:46462
I20260807 07:56:20.321802 28942 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:20.322031 28942 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:56:20.326341 28942 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.327684 28942 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 4 election: Requested vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:20.328627 29172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:20.328598 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:20.329278 29172 raft_consensus.cc:3055] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:56:20.329339 29045 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:56:20.329757 29172 raft_consensus.cc:740] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:20.330570 29172 consensus_queue.cc:260] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.331866 29172 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:56:20.335795 29045 raft_consensus.cc:2468] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 4.
I20260807 07:56:20.336906 28890 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters:
I20260807 07:56:20.337742 29421 raft_consensus.cc:2804] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:56:20.338092 29172 raft_consensus.cc:2468] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 4.
I20260807 07:56:20.338136 29421 raft_consensus.cc:697] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 4 LEADER]: Becoming Leader. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:20.339143 29421 consensus_queue.cc:237] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.345659 28778 catalog_manager.cc:5697] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 reported cstate change: term changed from 3 to 4, leader changed from b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131) to 06730445eab14c99872e29a97027bf10 (127.27.64.129). New cstate: current_term: 4 leader_uuid: "06730445eab14c99872e29a97027bf10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:20.573225 29419 raft_consensus.cc:993] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce: : Instructing follower 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:20.573674 29412 raft_consensus.cc:1081] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 2 LEADER]: Signalling peer 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:20.574975 28942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a"
dest_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:46464
I20260807 07:56:20.575392 28942 raft_consensus.cc:493] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:20.575636 28942 raft_consensus.cc:3060] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:20.579871 28942 raft_consensus.cc:515] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.581187 28942 leader_election.cc:290] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 3 election: Requested vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:20.581971 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:20.582207 29172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:20.582407 29045 raft_consensus.cc:3055] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:56:20.582685 29045 raft_consensus.cc:740] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:20.582715 29172 raft_consensus.cc:3060] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:20.583357 29045 consensus_queue.cc:260] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.584225 29045 raft_consensus.cc:3060] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:20.587211 29172 raft_consensus.cc:2468] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 3.
I20260807 07:56:20.588160 28895 leader_election.cc:304] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:20.588295 29045 raft_consensus.cc:2468] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 3.
I20260807 07:56:20.588935 29421 raft_consensus.cc:2804] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:56:20.589418 29421 raft_consensus.cc:697] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 3 LEADER]: Becoming Leader. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:20.590173 29421 consensus_queue.cc:237] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.596305 28778 catalog_manager.cc:5697] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 reported cstate change: term changed from 2 to 3, leader changed from 313fe8fb51e84e1ea251584f55792fce (127.27.64.130) to 06730445eab14c99872e29a97027bf10 (127.27.64.129). New cstate: current_term: 3 leader_uuid: "06730445eab14c99872e29a97027bf10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:20.628778 29419 raft_consensus.cc:993] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce: : Instructing follower 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:20.629228 29412 raft_consensus.cc:1081] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Signalling peer 06730445eab14c99872e29a97027bf10 to start an election
I20260807 07:56:20.630539 28942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6"
dest_uuid: "06730445eab14c99872e29a97027bf10"
from {username='slave'} at 127.0.0.1:46464
I20260807 07:56:20.630921 28942 raft_consensus.cc:493] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:20.631137 28942 raft_consensus.cc:3060] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:20.635360 28942 raft_consensus.cc:515] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.636866 28942 leader_election.cc:290] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Requested vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:20.637605 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:20.637924 29172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:20.638141 29045 raft_consensus.cc:3055] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:56:20.638417 29045 raft_consensus.cc:740] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:20.638420 29172 raft_consensus.cc:3060] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:20.639134 29045 consensus_queue.cc:260] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.639971 29045 raft_consensus.cc:3060] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:20.643014 29172 raft_consensus.cc:2468] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 2.
I20260807 07:56:20.643908 28895 leader_election.cc:304] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:20.644270 29045 raft_consensus.cc:2468] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 2.
I20260807 07:56:20.644502 29421 raft_consensus.cc:2804] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:56:20.644968 29421 raft_consensus.cc:697] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Becoming Leader. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:20.645748 29421 consensus_queue.cc:237] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:20.652258 28778 catalog_manager.cc:5697] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 reported cstate change: term changed from 1 to 2, leader changed from 313fe8fb51e84e1ea251584f55792fce (127.27.64.130) to 06730445eab14c99872e29a97027bf10 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "06730445eab14c99872e29a97027bf10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:20.729291 29045 raft_consensus.cc:1275] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:20.730459 29421 consensus_queue.cc:1048] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:20.739449 29172 raft_consensus.cc:1275] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:20.740897 29381 consensus_queue.cc:1048] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:20.741448 29045 raft_consensus.cc:1275] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:56:20.742808 29381 consensus_queue.cc:1048] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:56:20.755939 29172 raft_consensus.cc:1275] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:56:20.757514 29425 consensus_queue.cc:1048] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:56:20.836390 29045 raft_consensus.cc:1275] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:56:20.837509 29425 consensus_queue.cc:1048] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:56:20.845741 29172 raft_consensus.cc:1275] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:56:20.847247 29425 consensus_queue.cc:1048] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:56:21.074321 29172 raft_consensus.cc:1275] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:56:21.075436 29425 consensus_queue.cc:1048] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:21.084038 29045 raft_consensus.cc:1275] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:56:21.085813 29425 consensus_queue.cc:1048] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:21.112038 29045 raft_consensus.cc:1275] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:21.113212 29425 consensus_queue.cc:1048] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:21.121851 29172 raft_consensus.cc:1275] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:56:21.123409 29424 consensus_queue.cc:1048] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:24.176013 29462 raft_consensus.cc:493] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b9228a7f7f1f4ff984e6bdbc480fecc2)
I20260807 07:56:24.177196 29462 raft_consensus.cc:515] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.181674 29462 leader_election.cc:290] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:24.194003 29463 raft_consensus.cc:493] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:24.271287 29463 raft_consensus.cc:515] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.259423 29465 raft_consensus.cc:493] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:24.273644 29465 raft_consensus.cc:515] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.274257 29463 leader_election.cc:290] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:24.274768 29463 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:24.275202 29477 raft_consensus.cc:493] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:24.276001 29467 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:24.276499 29467 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.275863 29477 raft_consensus.cc:515] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.278360 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e6900e83d489b86a1417e4cd74169" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:24.279328 29467 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:24.279598 29477 leader_election.cc:290] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:24.281087 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:24.281710 29050 raft_consensus.cc:2468] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 2.
I20260807 07:56:24.263284 29473 raft_consensus.cc:493] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:24.283277 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:24.283852 29173 raft_consensus.cc:2468] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 2.
I20260807 07:56:24.284327 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:24.285225 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea4142012de4b6ea3550c5a9178a116" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:24.286068 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e6900e83d489b86a1417e4cd74169" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:24.286651 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:24.289188 29002 leader_election.cc:304] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:24.275228 29463 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.290288 29170 raft_consensus.cc:2468] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 4.
I20260807 07:56:24.291250 29473 raft_consensus.cc:515] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.294562 29167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:24.261070 29469 raft_consensus.cc:493] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 313fe8fb51e84e1ea251584f55792fce)
I20260807 07:56:24.297773 29469 raft_consensus.cc:515] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.299392 29110 leader_election.cc:304] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:24.305527 29475 raft_consensus.cc:2804] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:56:24.275774 29465 leader_election.cc:290] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:24.308193 29475 raft_consensus.cc:493] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:24.309785 29475 raft_consensus.cc:3060] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:24.313721 29112 leader_election.cc:304] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce
I20260807 07:56:24.314604 29465 raft_consensus.cc:2749] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:56:24.321704 29467 raft_consensus.cc:2804] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:56:24.354354 28937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a136c96874492cbf476b53d967403e" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:24.322990 29469 leader_election.cc:290] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:24.358305 29467 raft_consensus.cc:493] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Starting leader election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:24.358788 29467 raft_consensus.cc:3060] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:24.327663 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:24.333911 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ea4142012de4b6ea3550c5a9178a116" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:24.347034 28941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:24.337064 28938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:24.364046 28890 leader_election.cc:304] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06730445eab14c99872e29a97027bf10; no voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:24.364516 29475 raft_consensus.cc:515] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.365391 29471 raft_consensus.cc:2749] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:56:24.334792 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:24.314636 29473 leader_election.cc:290] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
W20260807 07:56:24.366918 29110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:41877, user_credentials={real_user=slave}} blocked reactor thread for 67735.1us
I20260807 07:56:24.367458 29467 raft_consensus.cc:515] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.367977 29001 leader_election.cc:304] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce; no voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:24.369745 29473 raft_consensus.cc:2749] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:56:24.369797 29467 leader_election.cc:290] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 3 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:24.327549 29002 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:24.370736 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:24.371259 29467 raft_consensus.cc:2804] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:56:24.371665 29467 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Starting leader election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:24.372082 29467 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:56:24.372820 29475 leader_election.cc:290] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:24.373500 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:24.376856 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:24.376984 29045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a136c96874492cbf476b53d967403e" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:24.377278 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:24.378021 29050 raft_consensus.cc:2393] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in current term 3: Already voted for candidate 313fe8fb51e84e1ea251584f55792fce in this term.
I20260807 07:56:24.378999 29110 leader_election.cc:304] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce
I20260807 07:56:24.379822 29475 raft_consensus.cc:2749] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:56:24.380599 29110 leader_election.cc:304] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce
I20260807 07:56:24.379084 29002 leader_election.cc:304] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce; no voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:24.381434 29475 raft_consensus.cc:2749] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:56:24.382174 29473 raft_consensus.cc:2749] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:56:24.383004 29048 raft_consensus.cc:1240] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Rejecting Update request from peer 06730445eab14c99872e29a97027bf10 for earlier term 2. Current term is 3. Ops: []
I20260807 07:56:24.383622 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:24.381464 29467 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.379951 29463 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:24.384840 29110 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce
I20260807 07:56:24.386024 29463 raft_consensus.cc:2749] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:56:24.387080 29467 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 5 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:24.387157 29168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:24.388579 29466 consensus_queue.cc:1059] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:56:24.389849 29470 raft_consensus.cc:3055] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:56:24.390117 29470 raft_consensus.cc:740] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:24.390676 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:24.391054 29470 consensus_queue.cc:260] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.391825 29001 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce; no voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:24.392038 29470 raft_consensus.cc:3060] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:24.392544 29467 raft_consensus.cc:2749] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:56:24.401443 27906 auto_leader_rebalancer-test.cc:507] The leader distribution is
I20260807 07:56:24.402115 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:24.409173 28939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dc7fe03092c42cba6694d2a11392e15"
dest_uuid: "06730445eab14c99872e29a97027bf10"
mode: GRACEFUL
new_leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
from {username='slave'} at 127.0.0.1:46468
I20260807 07:56:24.409742 28939 raft_consensus.cc:606] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Received request to transfer leadership to TS b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:24.412385 28939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e"
dest_uuid: "06730445eab14c99872e29a97027bf10"
mode: GRACEFUL
new_leader_uuid: "313fe8fb51e84e1ea251584f55792fce"
from {username='slave'} at 127.0.0.1:46468
I20260807 07:56:24.412807 28939 raft_consensus.cc:606] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 4 LEADER]: Received request to transfer leadership to TS 313fe8fb51e84e1ea251584f55792fce
I20260807 07:56:24.413569 29466 raft_consensus.cc:993] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10: : Instructing follower b9228a7f7f1f4ff984e6bdbc480fecc2 to start an election
I20260807 07:56:24.414000 29470 raft_consensus.cc:1081] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Signalling peer b9228a7f7f1f4ff984e6bdbc480fecc2 to start an election
I20260807 07:56:24.415114 28939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f"
dest_uuid: "06730445eab14c99872e29a97027bf10"
mode: GRACEFUL
new_leader_uuid: "313fe8fb51e84e1ea251584f55792fce"
from {username='slave'} at 127.0.0.1:46468
I20260807 07:56:24.415351 29168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dc7fe03092c42cba6694d2a11392e15"
dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
from {username='slave'} at 127.0.0.1:47742
I20260807 07:56:24.415524 28939 raft_consensus.cc:606] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Received request to transfer leadership to TS 313fe8fb51e84e1ea251584f55792fce
I20260807 07:56:24.415920 29168 raft_consensus.cc:493] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:24.416316 29168 raft_consensus.cc:3060] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:24.417872 28939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6901eb624c64f168d9b8e6668309d5d"
dest_uuid: "06730445eab14c99872e29a97027bf10"
mode: GRACEFUL
new_leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
from {username='slave'} at 127.0.0.1:46468
I20260807 07:56:24.418265 28939 raft_consensus.cc:606] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Received request to transfer leadership to TS b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:24.419250 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 07:56:24.419684 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:24.422098 29168 raft_consensus.cc:515] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.423800 29168 leader_election.cc:290] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:24.424335 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc7fe03092c42cba6694d2a11392e15" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:24.424830 28939 raft_consensus.cc:3055] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:56:24.424767 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc7fe03092c42cba6694d2a11392e15" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:24.425144 28939 raft_consensus.cc:740] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:24.425341 29050 raft_consensus.cc:3060] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:24.425836 28939 consensus_queue.cc:260] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.426716 28939 raft_consensus.cc:3060] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:24.429749 29050 raft_consensus.cc:2468] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 3.
I20260807 07:56:24.430615 29110 leader_election.cc:304] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:24.431447 29463 raft_consensus.cc:2804] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:56:24.431803 29463 raft_consensus.cc:697] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Becoming Leader. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:24.431939 28939 raft_consensus.cc:2468] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 3.
I20260807 07:56:24.432726 29463 consensus_queue.cc:237] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.441251 28779 catalog_manager.cc:5697] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 reported cstate change: term changed from 2 to 3, leader changed from 06730445eab14c99872e29a97027bf10 (127.27.64.129) to b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131). New cstate: current_term: 3 leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:24.709885 29050 raft_consensus.cc:1240] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 5 FOLLOWER]: Rejecting Update request from peer 06730445eab14c99872e29a97027bf10 for earlier term 4. Current term is 5. Ops: []
I20260807 07:56:24.711166 29470 consensus_queue.cc:1059] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:56:24.712263 29466 raft_consensus.cc:3055] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:56:24.712608 29466 raft_consensus.cc:740] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:24.713465 29466 consensus_queue.cc:260] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.714639 29466 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:56:24.735504 29470 raft_consensus.cc:993] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10: : Instructing follower 313fe8fb51e84e1ea251584f55792fce to start an election
I20260807 07:56:24.735913 29466 raft_consensus.cc:1081] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Signalling peer 313fe8fb51e84e1ea251584f55792fce to start an election
I20260807 07:56:24.737272 29050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f"
dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
from {username='slave'} at 127.0.0.1:36950
I20260807 07:56:24.737737 29050 raft_consensus.cc:493] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:24.737988 29050 raft_consensus.cc:3060] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:24.742362 29050 raft_consensus.cc:515] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.743782 29050 leader_election.cc:290] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 3 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:24.744504 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:24.744803 29168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d1eb69c6d349e197aec078a5013c8f" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:24.744948 28939 raft_consensus.cc:3055] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:56:24.745292 29168 raft_consensus.cc:3060] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:24.745313 28939 raft_consensus.cc:740] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:24.746152 28939 consensus_queue.cc:260] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.746927 28939 raft_consensus.cc:3060] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:24.750021 29168 raft_consensus.cc:2468] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 3.
I20260807 07:56:24.750864 28939 raft_consensus.cc:2468] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 3.
I20260807 07:56:24.750905 29002 leader_election.cc:304] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:24.751600 29467 raft_consensus.cc:2804] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:56:24.752091 29467 raft_consensus.cc:697] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 3 LEADER]: Becoming Leader. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:24.752799 29467 consensus_queue.cc:237] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.760795 28779 catalog_manager.cc:5697] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce reported cstate change: term changed from 2 to 3, leader changed from 06730445eab14c99872e29a97027bf10 (127.27.64.129) to 313fe8fb51e84e1ea251584f55792fce (127.27.64.130). New cstate: current_term: 3 leader_uuid: "313fe8fb51e84e1ea251584f55792fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:24.766016 29470 raft_consensus.cc:993] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10: : Instructing follower 313fe8fb51e84e1ea251584f55792fce to start an election
I20260807 07:56:24.766518 29466 raft_consensus.cc:1081] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 4 LEADER]: Signalling peer 313fe8fb51e84e1ea251584f55792fce to start an election
I20260807 07:56:24.767984 29050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e"
dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
from {username='slave'} at 127.0.0.1:36950
I20260807 07:56:24.768419 29050 raft_consensus.cc:493] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:24.768800 29050 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:56:24.772915 29050 raft_consensus.cc:515] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.774362 29050 leader_election.cc:290] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 5 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:24.774967 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:24.775286 29168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8989db03218b4cdf997e655dcc849c8e" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:24.775450 28939 raft_consensus.cc:3055] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:56:24.775719 28939 raft_consensus.cc:740] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:24.775767 29168 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:56:24.776280 28939 consensus_queue.cc:260] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.777074 28939 raft_consensus.cc:3060] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:56:24.780478 29168 raft_consensus.cc:2468] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 5.
I20260807 07:56:24.781037 28939 raft_consensus.cc:2468] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 5.
I20260807 07:56:24.781337 29002 leader_election.cc:304] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:24.782001 29467 raft_consensus.cc:2804] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:56:24.782361 29467 raft_consensus.cc:697] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 5 LEADER]: Becoming Leader. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:24.783105 29467 consensus_queue.cc:237] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:24.787358 29466 raft_consensus.cc:993] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10: : Instructing follower b9228a7f7f1f4ff984e6bdbc480fecc2 to start an election
I20260807 07:56:24.787878 29471 raft_consensus.cc:1081] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Signalling peer b9228a7f7f1f4ff984e6bdbc480fecc2 to start an election
I20260807 07:56:24.789482 29168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6901eb624c64f168d9b8e6668309d5d"
dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
from {username='slave'} at 127.0.0.1:47742
I20260807 07:56:24.789987 29168 raft_consensus.cc:493] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:24.790323 29168 raft_consensus.cc:3060] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:24.793021 28779 catalog_manager.cc:5697] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce reported cstate change: term changed from 4 to 5, leader changed from 06730445eab14c99872e29a97027bf10 (127.27.64.129) to 313fe8fb51e84e1ea251584f55792fce (127.27.64.130). New cstate: current_term: 5 leader_uuid: "313fe8fb51e84e1ea251584f55792fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:24.795192 29168 raft_consensus.cc:515] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:24.798463 29168 leader_election.cc:290] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 election: Requested vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229)
I20260807 07:56:24.798745 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6901eb624c64f168d9b8e6668309d5d" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:24.799285 29050 raft_consensus.cc:3060] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:24.799433 28939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6901eb624c64f168d9b8e6668309d5d" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:24.799923 28939 raft_consensus.cc:3055] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:56:24.800208 28939 raft_consensus.cc:740] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:24.800984 28939 consensus_queue.cc:260] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:24.802065 28939 raft_consensus.cc:3060] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:24.808405 28939 raft_consensus.cc:2468] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 3.
I20260807 07:56:24.809356 29050 raft_consensus.cc:2468] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 3.
I20260807 07:56:24.809345 29112 leader_election.cc:304] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:24.810418 29463 raft_consensus.cc:2804] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:56:24.810983 29463 raft_consensus.cc:697] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Becoming Leader. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:24.812229 29463 consensus_queue.cc:237] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } }
I20260807 07:56:24.823369 28779 catalog_manager.cc:5697] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 reported cstate change: term changed from 2 to 3, leader changed from 06730445eab14c99872e29a97027bf10 (127.27.64.129) to b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131). New cstate: current_term: 3 leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:25.015336 28939 raft_consensus.cc:1275] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Refusing update from remote peer b9228a7f7f1f4ff984e6bdbc480fecc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:56:25.015409 29048 raft_consensus.cc:1275] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Refusing update from remote peer b9228a7f7f1f4ff984e6bdbc480fecc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:56:25.016515 29463 consensus_queue.cc:1048] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:25.017315 29475 consensus_queue.cc:1048] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:25.136732 28939 raft_consensus.cc:1275] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Refusing update from remote peer 313fe8fb51e84e1ea251584f55792fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:56:25.137861 29467 consensus_queue.cc:1048] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:25.148739 29168 raft_consensus.cc:1275] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Refusing update from remote peer 313fe8fb51e84e1ea251584f55792fce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:56:25.150696 29467 consensus_queue.cc:1048] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260807 07:56:25.219542 29214 debug-util.cc:398] Leaking SignalData structure 0x7b080015a540 after lost signal to thread 27911
W20260807 07:56:25.220551 29214 debug-util.cc:398] Leaking SignalData structure 0x7b08001da6a0 after lost signal to thread 28842
W20260807 07:56:25.221560 29214 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6c00 after lost signal to thread 28975
W20260807 07:56:25.222520 29214 debug-util.cc:398] Leaking SignalData structure 0x7b08001a75e0 after lost signal to thread 29086
W20260807 07:56:25.223513 29214 debug-util.cc:398] Leaking SignalData structure 0x7b080009fb80 after lost signal to thread 29219
I20260807 07:56:25.296192 28939 raft_consensus.cc:1275] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Refusing update from remote peer b9228a7f7f1f4ff984e6bdbc480fecc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:56:25.297763 29463 consensus_queue.cc:1048] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:25.308703 29048 raft_consensus.cc:1275] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Refusing update from remote peer b9228a7f7f1f4ff984e6bdbc480fecc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:56:25.311136 29475 consensus_queue.cc:1048] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:25.362768 28939 raft_consensus.cc:1275] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 5 FOLLOWER]: Refusing update from remote peer 313fe8fb51e84e1ea251584f55792fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:56:25.364099 29467 consensus_queue.cc:1048] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:56:25.374763 29168 raft_consensus.cc:1275] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 5 FOLLOWER]: Refusing update from remote peer 313fe8fb51e84e1ea251584f55792fce: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:56:25.376362 29500 consensus_queue.cc:1048] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:56:25.420660 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:25.426225 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:25.426682 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:25.999404 29471 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:25.999881 29471 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:26.001655 29471 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:26.002562 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:26.002858 29168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:26.003137 29048 raft_consensus.cc:2468] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 5.
I20260807 07:56:26.004191 28890 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters:
I20260807 07:56:26.004866 29471 raft_consensus.cc:2804] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:56:26.005223 29471 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:26.005575 29471 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:56:26.006079 29506 raft_consensus.cc:493] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:26.006472 29506 raft_consensus.cc:515] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:26.010483 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:26.011019 28942 raft_consensus.cc:2468] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 3.
I20260807 07:56:26.011432 29506 leader_election.cc:290] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:26.012524 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:26.012606 29112 leader_election.cc:304] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:26.013372 29475 raft_consensus.cc:2804] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:56:26.013754 29475 raft_consensus.cc:493] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:26.014014 29475 raft_consensus.cc:3060] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:56:26.015051 29471 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:26.017017 29471 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 6 election: Requested vote from peers 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:26.018069 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:26.018203 29168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "06730445eab14c99872e29a97027bf10" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:26.018589 29050 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:56:26.019627 29048 raft_consensus.cc:2468] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 3.
I20260807 07:56:26.022917 29475 raft_consensus.cc:515] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:26.023512 29050 raft_consensus.cc:2468] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06730445eab14c99872e29a97027bf10 in term 6.
I20260807 07:56:26.024431 28890 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce; no voters: b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:26.024941 29475 leader_election.cc:290] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 4 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:26.025426 29471 raft_consensus.cc:2804] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:56:26.026070 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10"
I20260807 07:56:26.026350 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f73f08eb7b4d2388d75f7c0bed25a6" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:26.026640 28942 raft_consensus.cc:3060] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:56:26.027334 29471 raft_consensus.cc:697] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 6 LEADER]: Becoming Leader. State: Replica: 06730445eab14c99872e29a97027bf10, State: Running, Role: LEADER
I20260807 07:56:26.028175 29471 consensus_queue.cc:237] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:26.029079 29050 raft_consensus.cc:3060] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:56:26.033584 28942 raft_consensus.cc:2468] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 4.
I20260807 07:56:26.034900 29112 leader_election.cc:304] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:26.035228 29050 raft_consensus.cc:2468] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 4.
I20260807 07:56:26.035748 29475 raft_consensus.cc:2804] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:56:26.036252 29475 raft_consensus.cc:697] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 LEADER]: Becoming Leader. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:26.037020 29475 consensus_queue.cc:237] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:26.042286 28779 catalog_manager.cc:5697] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "06730445eab14c99872e29a97027bf10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:26.047287 28778 catalog_manager.cc:5697] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 reported cstate change: term changed from 2 to 4, leader changed from 06730445eab14c99872e29a97027bf10 (127.27.64.129) to b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131). New cstate: current_term: 4 leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:26.162755 29475 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:26.163231 29475 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:26.164974 29475 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:26.165711 28942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "06730445eab14c99872e29a97027bf10" is_pre_election: true
I20260807 07:56:26.167593 29050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:26.168202 29050 raft_consensus.cc:2368] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9228a7f7f1f4ff984e6bdbc480fecc2 for earlier term 5. Current term is 6.
I20260807 07:56:26.169709 29110 leader_election.cc:400] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877) with higher term. Message: Invalid argument: T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9228a7f7f1f4ff984e6bdbc480fecc2 for earlier term 5. Current term is 6.
I20260807 07:56:26.169942 29110 leader_election.cc:403] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:56:26.170431 29475 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Advancing to term 6
I20260807 07:56:26.177544 29475 raft_consensus.cc:2749] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877) with higher term. Message: Invalid argument: T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b9228a7f7f1f4ff984e6bdbc480fecc2 for earlier term 5. Current term is 6.
I20260807 07:56:26.423540 29050 raft_consensus.cc:1275] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 6 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:56:26.424820 29471 consensus_queue.cc:1048] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:56:26.427704 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:26.437880 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:26.439872 29168 raft_consensus.cc:1275] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 6 FOLLOWER]: Refusing update from remote peer 06730445eab14c99872e29a97027bf10: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:56:26.441859 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:26.442545 29507 consensus_queue.cc:1048] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:56:26.562297 28942 raft_consensus.cc:1275] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 4 FOLLOWER]: Refusing update from remote peer b9228a7f7f1f4ff984e6bdbc480fecc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:56:26.563488 29475 consensus_queue.cc:1048] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:26.572816 29050 raft_consensus.cc:1275] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Refusing update from remote peer b9228a7f7f1f4ff984e6bdbc480fecc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:56:26.574343 29506 consensus_queue.cc:1048] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:27.442922 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:27.448590 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:27.449039 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:28.449867 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:28.455053 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:28.455492 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:29.456490 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:29.461948 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:29.462424 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:30.463303 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:30.468668 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:30.469125 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:31.470072 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:31.475319 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:31.475760 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:32.476946 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:32.482836 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:32.483264 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:33.484252 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:33.490257 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:33.490917 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:34.604899 27906 auto_leader_rebalancer-test.cc:518] The leader distribution is
I20260807 07:56:34.605362 27906 tablet_server.cc:179] TabletServer@127.27.64.129:0 shutting down...
W20260807 07:56:34.626359 28972 debug-util.cc:398] Leaking SignalData structure 0x7b080019ec80 after lost signal to thread 27911
W20260807 07:56:34.627219 28972 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5d60 after lost signal to thread 28842
W20260807 07:56:34.628211 28972 debug-util.cc:398] Leaking SignalData structure 0x7b08001911e0 after lost signal to thread 28975
W20260807 07:56:34.629774 28972 debug-util.cc:398] Leaking SignalData structure 0x7b080013f640 after lost signal to thread 29086
W20260807 07:56:34.631206 28972 debug-util.cc:398] Leaking SignalData structure 0x7b08001c51c0 after lost signal to thread 29219
I20260807 07:56:34.635537 27906 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260807 07:56:34.636313 27906 tablet_replica.cc:333] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10: stopping tablet replica
I20260807 07:56:34.637176 27906 raft_consensus.cc:2243] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [term 2 LEADER]: Raft consensus shutting down.
I20260807 07:56:34.638327 27906 raft_consensus.cc:2272] T 417e6900e83d489b86a1417e4cd74169 P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:34.640446 27906 tablet_replica.cc:333] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10: stopping tablet replica
I20260807 07:56:34.640978 27906 raft_consensus.cc:2243] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 6 LEADER]: Raft consensus shutting down.
I20260807 07:56:34.641964 27906 raft_consensus.cc:2272] T d368970ae10540af9ea28923e3cf4dc5 P 06730445eab14c99872e29a97027bf10 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:34.644047 27906 tablet_replica.cc:333] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10: stopping tablet replica
I20260807 07:56:34.644593 27906 raft_consensus.cc:2243] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:34.645040 27906 raft_consensus.cc:2272] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 06730445eab14c99872e29a97027bf10 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:34.647037 27906 tablet_replica.cc:333] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10: stopping tablet replica
I20260807 07:56:34.647719 27906 raft_consensus.cc:2243] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:34.648180 27906 raft_consensus.cc:2272] T 8ea4142012de4b6ea3550c5a9178a116 P 06730445eab14c99872e29a97027bf10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:34.650007 27906 tablet_replica.cc:333] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10: stopping tablet replica
I20260807 07:56:34.650475 27906 raft_consensus.cc:2243] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:34.650911 27906 raft_consensus.cc:2272] T 8989db03218b4cdf997e655dcc849c8e P 06730445eab14c99872e29a97027bf10 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:34.652794 27906 tablet_replica.cc:333] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10: stopping tablet replica
I20260807 07:56:34.653327 27906 raft_consensus.cc:2243] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:34.653786 27906 raft_consensus.cc:2272] T b0d1eb69c6d349e197aec078a5013c8f P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:34.655865 27906 tablet_replica.cc:333] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10: stopping tablet replica
I20260807 07:56:34.656356 27906 raft_consensus.cc:2243] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 3 LEADER]: Raft consensus shutting down.
I20260807 07:56:34.657123 27906 raft_consensus.cc:2272] T a5c1109e73ab4e2198a3018c92a9f63a P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:34.658921 27906 tablet_replica.cc:333] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10: stopping tablet replica
I20260807 07:56:34.659464 27906 raft_consensus.cc:2243] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:34.659871 27906 raft_consensus.cc:2272] T e6901eb624c64f168d9b8e6668309d5d P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:34.661896 27906 tablet_replica.cc:333] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10: stopping tablet replica
I20260807 07:56:34.662326 27906 raft_consensus.cc:2243] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:34.662703 27906 raft_consensus.cc:2272] T 26a136c96874492cbf476b53d967403e P 06730445eab14c99872e29a97027bf10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:34.664422 27906 tablet_replica.cc:333] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10: stopping tablet replica
I20260807 07:56:34.664837 27906 raft_consensus.cc:2243] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:34.665241 27906 raft_consensus.cc:2272] T 4dc7fe03092c42cba6694d2a11392e15 P 06730445eab14c99872e29a97027bf10 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260807 07:56:34.850883 29112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260807 07:56:34.854223 29112 consensus_peers.cc:597] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 -> Peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Couldn't send request to peer 06730445eab14c99872e29a97027bf10. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 07:56:34.900951 29001 consensus_peers.cc:597] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce -> Peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Couldn't send request to peer 06730445eab14c99872e29a97027bf10. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 07:56:34.914216 29112 consensus_peers.cc:597] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 -> Peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Couldn't send request to peer 06730445eab14c99872e29a97027bf10. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 07:56:35.050190 29112 consensus_peers.cc:597] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 -> Peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Couldn't send request to peer 06730445eab14c99872e29a97027bf10. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 07:56:35.054591 29001 consensus_peers.cc:597] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce -> Peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Couldn't send request to peer 06730445eab14c99872e29a97027bf10. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 07:56:35.094100 29001 consensus_peers.cc:597] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce -> Peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Couldn't send request to peer 06730445eab14c99872e29a97027bf10. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 07:56:35.112746 29112 consensus_peers.cc:597] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 -> Peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Couldn't send request to peer 06730445eab14c99872e29a97027bf10. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 07:56:35.695785 27906 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 28972)
I20260807 07:56:35.890645 29571 raft_consensus.cc:493] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:35.891296 29571 raft_consensus.cc:515] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:35.893966 29571 leader_election.cc:290] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:35.895347 29168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
W20260807 07:56:35.897912 29001 leader_election.cc:336] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111)
I20260807 07:56:35.899250 29001 leader_election.cc:304] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce; no voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:35.899994 29571 raft_consensus.cc:2749] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:56:35.933737 29571 raft_consensus.cc:493] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:35.934361 29571 raft_consensus.cc:515] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:35.937958 29571 leader_election.cc:290] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:35.939440 29168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e6900e83d489b86a1417e4cd74169" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
W20260807 07:56:35.941960 29001 leader_election.cc:336] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111)
I20260807 07:56:35.942392 29001 leader_election.cc:304] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce; no voters: 06730445eab14c99872e29a97027bf10, b9228a7f7f1f4ff984e6bdbc480fecc2
I20260807 07:56:35.943094 29571 raft_consensus.cc:2749] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:56:36.012815 29573 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:36.013294 29573 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:36.015551 29573 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:36.016867 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
W20260807 07:56:36.019094 29112 leader_election.cc:336] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111)
I20260807 07:56:36.019526 29112 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10, 313fe8fb51e84e1ea251584f55792fce
I20260807 07:56:36.020210 29573 raft_consensus.cc:2749] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:56:36.055210 29573 raft_consensus.cc:493] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:36.055751 29573 raft_consensus.cc:515] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:36.058837 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:36.059459 29048 raft_consensus.cc:2468] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 3.
I20260807 07:56:36.059617 29573 leader_election.cc:290] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:36.060635 29110 leader_election.cc:304] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
I20260807 07:56:36.061344 29573 raft_consensus.cc:2804] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 07:56:36.061798 29112 leader_election.cc:336] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111)
I20260807 07:56:36.061833 29573 raft_consensus.cc:493] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:36.062325 29573 raft_consensus.cc:3060] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:56:36.069979 29573 raft_consensus.cc:515] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:36.072021 29573 leader_election.cc:290] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 4 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:36.073206 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c1109e73ab4e2198a3018c92a9f63a" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:36.073858 29048 raft_consensus.cc:3060] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:56:36.075372 29112 leader_election.cc:336] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111)
I20260807 07:56:36.080875 29048 raft_consensus.cc:2468] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 4.
I20260807 07:56:36.082048 29110 leader_election.cc:304] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10
I20260807 07:56:36.082785 29573 raft_consensus.cc:2804] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:56:36.083181 29573 raft_consensus.cc:697] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 LEADER]: Becoming Leader. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:36.084081 29573 consensus_queue.cc:237] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:36.086377 29572 raft_consensus.cc:493] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:36.086877 29572 raft_consensus.cc:515] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:36.089272 29572 leader_election.cc:290] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:36.090453 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e6900e83d489b86a1417e4cd74169" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce" is_pre_election: true
I20260807 07:56:36.093492 29048 raft_consensus.cc:2468] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 2.
W20260807 07:56:36.097496 29112 leader_election.cc:336] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111)
I20260807 07:56:36.098079 29110 leader_election.cc:304] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10
I20260807 07:56:36.099289 29557 raft_consensus.cc:2804] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:56:36.099633 29557 raft_consensus.cc:493] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:36.099996 28773 catalog_manager.cc:5697] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 reported cstate change: term changed from 3 to 4, leader changed from 06730445eab14c99872e29a97027bf10 (127.27.64.129) to b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131). New cstate: current_term: 4 leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:36.099952 29557 raft_consensus.cc:3060] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:36.108914 29557 raft_consensus.cc:515] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:36.109918 29571 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:36.110484 29571 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:36.112736 29571 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:36.114356 29168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" is_pre_election: true
I20260807 07:56:36.117205 29168 raft_consensus.cc:2468] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 6.
I20260807 07:56:36.118778 29002 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters:
W20260807 07:56:36.115885 29112 leader_election.cc:336] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111)
I20260807 07:56:36.119774 29571 raft_consensus.cc:2804] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 07:56:36.119879 29001 leader_election.cc:336] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111)
I20260807 07:56:36.120287 29571 raft_consensus.cc:493] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 6 FOLLOWER]: Starting leader election (detected failure of leader 06730445eab14c99872e29a97027bf10)
I20260807 07:56:36.120678 29571 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:56:36.126211 29557 leader_election.cc:290] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877)
I20260807 07:56:36.127542 29048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "417e6900e83d489b86a1417e4cd74169" candidate_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "313fe8fb51e84e1ea251584f55792fce"
I20260807 07:56:36.128289 29048 raft_consensus.cc:3060] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:56:36.130220 29571 raft_consensus.cc:515] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:36.133177 29168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d368970ae10540af9ea28923e3cf4dc5" candidate_uuid: "313fe8fb51e84e1ea251584f55792fce" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2"
I20260807 07:56:36.133443 29048 raft_consensus.cc:2468] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9228a7f7f1f4ff984e6bdbc480fecc2 in term 3.
I20260807 07:56:36.133723 29168 raft_consensus.cc:3060] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 6 FOLLOWER]: Advancing to term 7
W20260807 07:56:36.136005 29001 leader_election.cc:336] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111)
I20260807 07:56:36.137892 29571 leader_election.cc:290] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 7 election: Requested vote from peers 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229), b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131:42527)
I20260807 07:56:36.137879 29110 leader_election.cc:304] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10
I20260807 07:56:36.138725 29557 raft_consensus.cc:2804] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:56:36.139155 29557 raft_consensus.cc:697] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Becoming Leader. State: Replica: b9228a7f7f1f4ff984e6bdbc480fecc2, State: Running, Role: LEADER
I20260807 07:56:36.139961 29557 consensus_queue.cc:237] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:36.140429 29168 raft_consensus.cc:2468] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 313fe8fb51e84e1ea251584f55792fce in term 7.
I20260807 07:56:36.141602 29002 leader_election.cc:304] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 313fe8fb51e84e1ea251584f55792fce, b9228a7f7f1f4ff984e6bdbc480fecc2; no voters: 06730445eab14c99872e29a97027bf10
I20260807 07:56:36.143275 29571 raft_consensus.cc:2804] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:56:36.143818 29571 raft_consensus.cc:697] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 7 LEADER]: Becoming Leader. State: Replica: 313fe8fb51e84e1ea251584f55792fce, State: Running, Role: LEADER
I20260807 07:56:36.144711 29571 consensus_queue.cc:237] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } }
I20260807 07:56:36.154873 28773 catalog_manager.cc:5697] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 reported cstate change: term changed from 2 to 3, leader changed from 06730445eab14c99872e29a97027bf10 (127.27.64.129) to b9228a7f7f1f4ff984e6bdbc480fecc2 (127.27.64.131). New cstate: current_term: 3 leader_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:36.156737 28778 catalog_manager.cc:5697] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce reported cstate change: term changed from 6 to 7, leader changed from 06730445eab14c99872e29a97027bf10 (127.27.64.129) to 313fe8fb51e84e1ea251584f55792fce (127.27.64.130). New cstate: current_term: 7 leader_uuid: "313fe8fb51e84e1ea251584f55792fce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06730445eab14c99872e29a97027bf10" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 42229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:36.503554 29048 raft_consensus.cc:1275] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Refusing update from remote peer b9228a7f7f1f4ff984e6bdbc480fecc2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:56:36.504760 29573 consensus_queue.cc:1048] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260807 07:56:36.529212 29112 consensus_peers.cc:597] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 -> Peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Couldn't send request to peer 06730445eab14c99872e29a97027bf10. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260807 07:56:36.572382 29112 consensus_peers.cc:597] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 -> Peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Couldn't send request to peer 06730445eab14c99872e29a97027bf10. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:36.628952 29168 raft_consensus.cc:1275] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 7 FOLLOWER]: Refusing update from remote peer 313fe8fb51e84e1ea251584f55792fce: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:56:36.630399 29582 consensus_queue.cc:1048] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9228a7f7f1f4ff984e6bdbc480fecc2" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 42527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260807 07:56:36.646732 29001 consensus_peers.cc:597] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce -> Peer 06730445eab14c99872e29a97027bf10 (127.27.64.129:42229): Couldn't send request to peer 06730445eab14c99872e29a97027bf10. Status: Network error: Client connection negotiation failed: client connection to 127.27.64.129:42229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:36.650568 29048 raft_consensus.cc:1275] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Refusing update from remote peer b9228a7f7f1f4ff984e6bdbc480fecc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:56:36.651937 29557 consensus_queue.cc:1048] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "313fe8fb51e84e1ea251584f55792fce" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 41877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260807 07:56:36.696293 27906 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 28972)
I20260807 07:56:36.838457 27906 tablet_server.cc:196] TabletServer@127.27.64.129:0 shutdown complete.
I20260807 07:56:36.859834 27906 tablet_server.cc:179] TabletServer@127.27.64.130:0 shutting down...
I20260807 07:56:36.883234 27906 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260807 07:56:36.883881 27906 tablet_replica.cc:333] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce: stopping tablet replica
I20260807 07:56:36.884646 27906 raft_consensus.cc:2243] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:36.885236 27906 raft_consensus.cc:2272] T 8ea4142012de4b6ea3550c5a9178a116 P 313fe8fb51e84e1ea251584f55792fce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:36.887872 27906 tablet_replica.cc:333] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce: stopping tablet replica
W20260807 07:56:36.888516 29110 consensus_peers.cc:597] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 -> Peer 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877): Couldn't send request to peer 313fe8fb51e84e1ea251584f55792fce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:36.888643 27906 raft_consensus.cc:2243] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 5 LEADER]: Raft consensus shutting down.
I20260807 07:56:36.889575 27906 raft_consensus.cc:2272] T 8989db03218b4cdf997e655dcc849c8e P 313fe8fb51e84e1ea251584f55792fce [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:36.891384 27906 tablet_replica.cc:333] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce: stopping tablet replica
I20260807 07:56:36.892148 27906 raft_consensus.cc:2243] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [term 2 LEADER]: Raft consensus shutting down.
I20260807 07:56:36.893011 27906 raft_consensus.cc:2272] T 26a136c96874492cbf476b53d967403e P 313fe8fb51e84e1ea251584f55792fce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:36.895026 27906 tablet_replica.cc:333] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce: stopping tablet replica
I20260807 07:56:36.895493 27906 raft_consensus.cc:2243] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:36.895892 27906 raft_consensus.cc:2272] T 4dc7fe03092c42cba6694d2a11392e15 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:36.897502 27906 tablet_replica.cc:333] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce: stopping tablet replica
I20260807 07:56:36.897964 27906 raft_consensus.cc:2243] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:36.898360 27906 raft_consensus.cc:2272] T e6901eb624c64f168d9b8e6668309d5d P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:36.899901 27906 tablet_replica.cc:333] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce: stopping tablet replica
I20260807 07:56:36.900348 27906 raft_consensus.cc:2243] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:36.900743 27906 raft_consensus.cc:2272] T a5c1109e73ab4e2198a3018c92a9f63a P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:36.903213 27906 tablet_replica.cc:333] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce: stopping tablet replica
I20260807 07:56:36.903750 27906 raft_consensus.cc:2243] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 3 LEADER]: Raft consensus shutting down.
I20260807 07:56:36.904450 27906 raft_consensus.cc:2272] T b0d1eb69c6d349e197aec078a5013c8f P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:36.906137 27906 tablet_replica.cc:333] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce: stopping tablet replica
I20260807 07:56:36.906562 27906 raft_consensus.cc:2243] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 7 LEADER]: Raft consensus shutting down.
I20260807 07:56:36.907262 27906 raft_consensus.cc:2272] T d368970ae10540af9ea28923e3cf4dc5 P 313fe8fb51e84e1ea251584f55792fce [term 7 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:36.909003 27906 tablet_replica.cc:333] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce: stopping tablet replica
I20260807 07:56:36.909500 27906 raft_consensus.cc:2243] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:36.909886 27906 raft_consensus.cc:2272] T c6f73f08eb7b4d2388d75f7c0bed25a6 P 313fe8fb51e84e1ea251584f55792fce [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:36.911505 27906 tablet_replica.cc:333] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce: stopping tablet replica
I20260807 07:56:36.911902 27906 raft_consensus.cc:2243] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:36.912304 27906 raft_consensus.cc:2272] T 417e6900e83d489b86a1417e4cd74169 P 313fe8fb51e84e1ea251584f55792fce [term 3 FOLLOWER]: Raft consensus is shut down!
W20260807 07:56:36.920950 29110 consensus_peers.cc:597] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 -> Peer 313fe8fb51e84e1ea251584f55792fce (127.27.64.130:41877): Couldn't send request to peer 313fe8fb51e84e1ea251584f55792fce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:36.941893 27906 tablet_server.cc:196] TabletServer@127.27.64.130:0 shutdown complete.
I20260807 07:56:36.960675 27906 tablet_server.cc:179] TabletServer@127.27.64.131:0 shutting down...
I20260807 07:56:36.986236 27906 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260807 07:56:36.986877 27906 tablet_replica.cc:333] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2: stopping tablet replica
I20260807 07:56:36.987453 27906 raft_consensus.cc:2243] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Raft consensus shutting down.
I20260807 07:56:36.988364 27906 raft_consensus.cc:2272] T 417e6900e83d489b86a1417e4cd74169 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:36.990398 27906 tablet_replica.cc:333] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2: stopping tablet replica
I20260807 07:56:36.990924 27906 raft_consensus.cc:2243] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Raft consensus shutting down.
I20260807 07:56:36.991672 27906 raft_consensus.cc:2272] T 4dc7fe03092c42cba6694d2a11392e15 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:36.993530 27906 tablet_replica.cc:333] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2: stopping tablet replica
I20260807 07:56:36.994009 27906 raft_consensus.cc:2243] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:36.994422 27906 raft_consensus.cc:2272] T 26a136c96874492cbf476b53d967403e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:36.996040 27906 tablet_replica.cc:333] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2: stopping tablet replica
I20260807 07:56:36.996500 27906 raft_consensus.cc:2243] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 LEADER]: Raft consensus shutting down.
I20260807 07:56:36.997215 27906 raft_consensus.cc:2272] T e6901eb624c64f168d9b8e6668309d5d P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:36.998901 27906 tablet_replica.cc:333] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2: stopping tablet replica
I20260807 07:56:36.999363 27906 raft_consensus.cc:2243] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:36.999763 27906 raft_consensus.cc:2272] T 8989db03218b4cdf997e655dcc849c8e P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:37.001322 27906 tablet_replica.cc:333] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2: stopping tablet replica
I20260807 07:56:37.001883 27906 raft_consensus.cc:2243] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:56:37.002545 27906 raft_consensus.cc:2272] T 8ea4142012de4b6ea3550c5a9178a116 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:37.004058 27906 tablet_replica.cc:333] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2: stopping tablet replica
I20260807 07:56:37.004523 27906 raft_consensus.cc:2243] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:37.004909 27906 raft_consensus.cc:2272] T d368970ae10540af9ea28923e3cf4dc5 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:37.006812 27906 tablet_replica.cc:333] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2: stopping tablet replica
I20260807 07:56:37.007266 27906 raft_consensus.cc:2243] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 LEADER]: Raft consensus shutting down.
I20260807 07:56:37.007938 27906 raft_consensus.cc:2272] T c6f73f08eb7b4d2388d75f7c0bed25a6 P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:37.009474 27906 tablet_replica.cc:333] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2: stopping tablet replica
I20260807 07:56:37.009927 27906 raft_consensus.cc:2243] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 LEADER]: Raft consensus shutting down.
I20260807 07:56:37.010632 27906 raft_consensus.cc:2272] T a5c1109e73ab4e2198a3018c92a9f63a P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:37.012328 27906 tablet_replica.cc:333] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2: stopping tablet replica
I20260807 07:56:37.012746 27906 raft_consensus.cc:2243] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:37.013134 27906 raft_consensus.cc:2272] T b0d1eb69c6d349e197aec078a5013c8f P b9228a7f7f1f4ff984e6bdbc480fecc2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:37.057010 27906 tablet_server.cc:196] TabletServer@127.27.64.131:0 shutdown complete.
I20260807 07:56:37.077276 27906 master.cc:562] Master@127.27.64.190:39429 shutting down...
I20260807 07:56:37.099537 27906 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:56:37.100028 27906 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:37.100317 27906 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2fdb5674f39848dcb4988f49953d92de: stopping tablet replica
I20260807 07:56:37.120349 27906 master.cc:584] Master@127.27.64.190:39429 shutdown complete.
06730445eab14c99872e29a97027bf10 5
313fe8fb51e84e1ea251584f55792fce 4
b9228a7f7f1f4ff984e6bdbc480fecc2 1
06730445eab14c99872e29a97027bf10 3
313fe8fb51e84e1ea251584f55792fce 4
b9228a7f7f1f4ff984e6bdbc480fecc2 3
06730445eab14c99872e29a97027bf10 8
313fe8fb51e84e1ea251584f55792fce 1
b9228a7f7f1f4ff984e6bdbc480fecc2 1
06730445eab14c99872e29a97027bf10 3
313fe8fb51e84e1ea251584f55792fce 3
b9228a7f7f1f4ff984e6bdbc480fecc2 4
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (31918 ms)
[ RUN ] LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass
I20260807 07:56:37.160862 27906 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.64.190:34623
I20260807 07:56:37.162047 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:56:37.167359 29595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:37.167375 29593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:37.169620 29598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:37.169785 27906 server_base.cc:1061] running on GCE node
I20260807 07:56:37.171365 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:56:37.171541 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:56:37.171663 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089397171653 us; error 0 us; skew 500 ppm
I20260807 07:56:37.172111 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:56:37.174393 27906 webserver.cc:533] Webserver started at http://127.27.64.190:37623/ using document root <none> and password file <none>
I20260807 07:56:37.174842 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:56:37.175012 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:56:37.175232 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:56:37.176311 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/master-0-root/instance:
uuid: "9410dbdb906a42e7aa8a9b52ba0dd15c"
format_stamp: "Formatted at 2026-08-07 07:56:37 on dist-test-slave-f0tn"
I20260807 07:56:37.180883 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 07:56:37.184144 29606 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:37.184820 27906 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 07:56:37.185081 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/master-0-root
uuid: "9410dbdb906a42e7aa8a9b52ba0dd15c"
format_stamp: "Formatted at 2026-08-07 07:56:37 on dist-test-slave-f0tn"
I20260807 07:56:37.185350 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:56:37.221180 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:56:37.222544 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:56:37.260353 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.190:34623
I20260807 07:56:37.260442 29683 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.190:34623 every 8 connection(s)
I20260807 07:56:37.264189 29684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.273729 29684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c: Bootstrap starting.
I20260807 07:56:37.278281 29684 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:37.282311 29684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c: No bootstrap required, opened a new log
I20260807 07:56:37.284317 29684 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9410dbdb906a42e7aa8a9b52ba0dd15c" member_type: VOTER }
I20260807 07:56:37.284667 29684 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:37.284845 29684 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9410dbdb906a42e7aa8a9b52ba0dd15c, State: Initialized, Role: FOLLOWER
I20260807 07:56:37.285317 29684 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9410dbdb906a42e7aa8a9b52ba0dd15c" member_type: VOTER }
I20260807 07:56:37.285743 29684 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:56:37.285943 29684 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:56:37.286147 29684 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:37.290374 29684 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9410dbdb906a42e7aa8a9b52ba0dd15c" member_type: VOTER }
I20260807 07:56:37.290838 29684 leader_election.cc:304] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9410dbdb906a42e7aa8a9b52ba0dd15c; no voters:
I20260807 07:56:37.291882 29684 leader_election.cc:290] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:56:37.292155 29688 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:37.293442 29688 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [term 1 LEADER]: Becoming Leader. State: Replica: 9410dbdb906a42e7aa8a9b52ba0dd15c, State: Running, Role: LEADER
I20260807 07:56:37.294090 29688 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9410dbdb906a42e7aa8a9b52ba0dd15c" member_type: VOTER }
I20260807 07:56:37.294685 29684 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:56:37.298393 29692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9410dbdb906a42e7aa8a9b52ba0dd15c. Latest consensus state: current_term: 1 leader_uuid: "9410dbdb906a42e7aa8a9b52ba0dd15c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9410dbdb906a42e7aa8a9b52ba0dd15c" member_type: VOTER } }
I20260807 07:56:37.298945 29692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [sys.catalog]: This master's current role is: LEADER
I20260807 07:56:37.298761 29691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9410dbdb906a42e7aa8a9b52ba0dd15c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9410dbdb906a42e7aa8a9b52ba0dd15c" member_type: VOTER } }
I20260807 07:56:37.299252 29691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [sys.catalog]: This master's current role is: LEADER
I20260807 07:56:37.300977 29702 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260807 07:56:37.308132 29702 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260807 07:56:37.309114 27906 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 07:56:37.316373 29702 catalog_manager.cc:1383] Generated new cluster ID: 6b0fc71a9d4743e788ad5d053dce2116
I20260807 07:56:37.316628 29702 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260807 07:56:37.334753 29702 catalog_manager.cc:1406] Generated new certificate authority record
I20260807 07:56:37.335960 29702 catalog_manager.cc:1540] Loading token signing keys...
I20260807 07:56:37.350735 29702 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c: Generated new TSK 0
I20260807 07:56:37.351251 29702 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260807 07:56:37.375584 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:56:37.381702 29718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:37.382809 29720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:37.384346 29724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:37.384481 27906 server_base.cc:1061] running on GCE node
I20260807 07:56:37.385661 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:56:37.385848 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:56:37.385967 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089397385956 us; error 0 us; skew 500 ppm
I20260807 07:56:37.386432 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:56:37.388657 27906 webserver.cc:533] Webserver started at http://127.27.64.129:43421/ using document root <none> and password file <none>
I20260807 07:56:37.389150 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:56:37.389307 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:56:37.389575 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:56:37.390673 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-0-root/instance:
uuid: "50da146479da477d9d1a1758f1f7a3ac"
format_stamp: "Formatted at 2026-08-07 07:56:37 on dist-test-slave-f0tn"
I20260807 07:56:37.395040 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 07:56:37.398276 29735 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:37.398955 27906 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 07:56:37.399220 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-0-root
uuid: "50da146479da477d9d1a1758f1f7a3ac"
format_stamp: "Formatted at 2026-08-07 07:56:37 on dist-test-slave-f0tn"
I20260807 07:56:37.399478 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:56:37.415010 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:56:37.416318 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:56:37.417825 27906 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 07:56:37.420085 27906 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:56:37.420261 27906 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:37.420491 27906 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 07:56:37.420639 27906 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:37.460422 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.129:45511
I20260807 07:56:37.460537 29835 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.129:45511 every 8 connection(s)
I20260807 07:56:37.465219 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:56:37.472456 29844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:37.474841 29847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:37.476356 29853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:37.478554 27906 server_base.cc:1061] running on GCE node
I20260807 07:56:37.479714 29837 heartbeater.cc:344] Connected to a master server at 127.27.64.190:34623
I20260807 07:56:37.479857 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260807 07:56:37.480087 29837 heartbeater.cc:461] Registering TS with master...
W20260807 07:56:37.480131 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:56:37.480424 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089397480405 us; error 0 us; skew 500 ppm
I20260807 07:56:37.480901 29837 heartbeater.cc:507] Master 127.27.64.190:34623 requested a full tablet report, sending...
I20260807 07:56:37.480965 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:56:37.483250 29636 ts_manager.cc:194] Registered new tserver with Master: 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129:45511)
I20260807 07:56:37.483625 27906 webserver.cc:533] Webserver started at http://127.27.64.130:39251/ using document root <none> and password file <none>
I20260807 07:56:37.484251 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:56:37.484490 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:56:37.484814 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:56:37.485618 29636 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60922
I20260807 07:56:37.486312 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-1-root/instance:
uuid: "cc25be82c34f42618ff8445be30e4c70"
format_stamp: "Formatted at 2026-08-07 07:56:37 on dist-test-slave-f0tn"
I20260807 07:56:37.491390 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 07:56:37.494539 29860 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:37.495203 27906 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 07:56:37.495460 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-1-root
uuid: "cc25be82c34f42618ff8445be30e4c70"
format_stamp: "Formatted at 2026-08-07 07:56:37 on dist-test-slave-f0tn"
I20260807 07:56:37.495719 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:56:37.511991 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:56:37.513428 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:56:37.514967 27906 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 07:56:37.517233 27906 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:56:37.517447 27906 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 07:56:37.517688 27906 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 07:56:37.517835 27906 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:37.557782 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.130:43161
I20260807 07:56:37.557898 29956 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.130:43161 every 8 connection(s)
I20260807 07:56:37.562470 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:56:37.569447 29963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:37.571048 29965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:37.573617 29967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:37.573822 27906 server_base.cc:1061] running on GCE node
I20260807 07:56:37.574862 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260807 07:56:37.574959 29958 heartbeater.cc:344] Connected to a master server at 127.27.64.190:34623
W20260807 07:56:37.575137 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:56:37.575352 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089397575336 us; error 0 us; skew 500 ppm
I20260807 07:56:37.575369 29958 heartbeater.cc:461] Registering TS with master...
I20260807 07:56:37.576221 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:56:37.576378 29958 heartbeater.cc:507] Master 127.27.64.190:34623 requested a full tablet report, sending...
I20260807 07:56:37.578714 27906 webserver.cc:533] Webserver started at http://127.27.64.131:43771/ using document root <none> and password file <none>
I20260807 07:56:37.578703 29636 ts_manager.cc:194] Registered new tserver with Master: cc25be82c34f42618ff8445be30e4c70 (127.27.64.130:43161)
I20260807 07:56:37.579514 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:56:37.579782 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:56:37.580093 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:56:37.580561 29636 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60924
I20260807 07:56:37.581620 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-2-root/instance:
uuid: "5f20fe56414c482e843f889d8ff335d3"
format_stamp: "Formatted at 2026-08-07 07:56:37 on dist-test-slave-f0tn"
I20260807 07:56:37.586349 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 07:56:37.589498 29981 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:37.590206 27906 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 07:56:37.590464 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-2-root
uuid: "5f20fe56414c482e843f889d8ff335d3"
format_stamp: "Formatted at 2026-08-07 07:56:37 on dist-test-slave-f0tn"
I20260807 07:56:37.590708 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass.1786089331872967-27906-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:56:37.602516 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:56:37.603781 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:56:37.605238 27906 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 07:56:37.607416 27906 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:56:37.607609 27906 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:37.607836 27906 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 07:56:37.607985 27906 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:37.645864 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.131:46243
I20260807 07:56:37.645965 30078 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.131:46243 every 8 connection(s)
I20260807 07:56:37.658951 30081 heartbeater.cc:344] Connected to a master server at 127.27.64.190:34623
I20260807 07:56:37.659299 30081 heartbeater.cc:461] Registering TS with master...
I20260807 07:56:37.660020 30081 heartbeater.cc:507] Master 127.27.64.190:34623 requested a full tablet report, sending...
I20260807 07:56:37.661827 29636 ts_manager.cc:194] Registered new tserver with Master: 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243)
I20260807 07:56:37.662168 27906 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013276016s
I20260807 07:56:37.663110 29636 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60938
I20260807 07:56:37.686645 29636 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60954:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000UUU\025\004\001\000\252\252\252*\004\001\000\377\377\377?\004\001\000TUUU\004\001\000\251\252\252j""\004\001\000UUU\025\004\001\000\252\252\252*\004\001\000\377\377\377?\004\001\000TUUU\004\001\000\251\252\252j"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 07:56:37.689244 29636 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 07:56:37.747480 29776 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7e0974a32c4f3badc1a64cff604134 (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260807 07:56:37.749080 29776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7e0974a32c4f3badc1a64cff604134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.754849 29775 tablet_service.cc:1511] Processing CreateTablet for tablet 94516c5a3e66456688417841a07abf62 (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260807 07:56:37.756258 29775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94516c5a3e66456688417841a07abf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.761001 29771 tablet_service.cc:1511] Processing CreateTablet for tablet 61189e76a3c848d693e6eed5cedc8b99 (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260807 07:56:37.762398 29771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61189e76a3c848d693e6eed5cedc8b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.762558 29773 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce70ac8492c4e3eaa7dbc4b245ff835 (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260807 07:56:37.763859 29773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce70ac8492c4e3eaa7dbc4b245ff835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.764302 29772 tablet_service.cc:1511] Processing CreateTablet for tablet 51a024f0de4f4bff825cf96716d3b59a (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260807 07:56:37.765619 29772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51a024f0de4f4bff825cf96716d3b59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.775696 29770 tablet_service.cc:1511] Processing CreateTablet for tablet f29619c1ec0c4f0ba1995d9389666fdc (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260807 07:56:37.777069 29770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f29619c1ec0c4f0ba1995d9389666fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.781791 30027 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7e0974a32c4f3badc1a64cff604134 (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260807 07:56:37.783077 30027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7e0974a32c4f3badc1a64cff604134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.785213 30024 tablet_service.cc:1511] Processing CreateTablet for tablet 94516c5a3e66456688417841a07abf62 (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260807 07:56:37.786387 30107 tablet_bootstrap.cc:492] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac: Bootstrap starting.
I20260807 07:56:37.786531 30024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94516c5a3e66456688417841a07abf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.786701 30017 tablet_service.cc:1511] Processing CreateTablet for tablet f29619c1ec0c4f0ba1995d9389666fdc (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260807 07:56:37.787947 30017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f29619c1ec0c4f0ba1995d9389666fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.788975 29909 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7e0974a32c4f3badc1a64cff604134 (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION VALUES < 357913941
I20260807 07:56:37.790402 29909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7e0974a32c4f3badc1a64cff604134. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.790159 30019 tablet_service.cc:1511] Processing CreateTablet for tablet 61189e76a3c848d693e6eed5cedc8b99 (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260807 07:56:37.791409 30019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61189e76a3c848d693e6eed5cedc8b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.791177 30023 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce70ac8492c4e3eaa7dbc4b245ff835 (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260807 07:56:37.792411 30023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce70ac8492c4e3eaa7dbc4b245ff835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.792961 30107 tablet_bootstrap.cc:654] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:37.797415 30020 tablet_service.cc:1511] Processing CreateTablet for tablet 51a024f0de4f4bff825cf96716d3b59a (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260807 07:56:37.798743 30020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51a024f0de4f4bff825cf96716d3b59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.804360 29908 tablet_service.cc:1511] Processing CreateTablet for tablet 94516c5a3e66456688417841a07abf62 (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 357913941 <= VALUES < 715827882
I20260807 07:56:37.805742 29908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94516c5a3e66456688417841a07abf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.822139 30107 tablet_bootstrap.cc:492] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac: No bootstrap required, opened a new log
I20260807 07:56:37.822657 30107 ts_tablet_manager.cc:1403] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac: Time spent bootstrapping tablet: real 0.037s user 0.011s sys 0.022s
I20260807 07:56:37.825156 29907 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce70ac8492c4e3eaa7dbc4b245ff835 (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1073741823
I20260807 07:56:37.825654 30107 raft_consensus.cc:359] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:37.826367 30107 raft_consensus.cc:385] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:37.826493 29907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce70ac8492c4e3eaa7dbc4b245ff835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.826673 30107 raft_consensus.cc:740] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da146479da477d9d1a1758f1f7a3ac, State: Initialized, Role: FOLLOWER
I20260807 07:56:37.827507 30107 consensus_queue.cc:260] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:37.838600 30107 ts_tablet_manager.cc:1434] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac: Time spent starting tablet: real 0.016s user 0.006s sys 0.007s
I20260807 07:56:37.839303 29837 heartbeater.cc:499] Master 127.27.64.190:34623 was elected leader, sending a full tablet report...
I20260807 07:56:37.839044 29906 tablet_service.cc:1511] Processing CreateTablet for tablet 51a024f0de4f4bff825cf96716d3b59a (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES < 1431655764
I20260807 07:56:37.840349 29906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51a024f0de4f4bff825cf96716d3b59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.842197 30107 tablet_bootstrap.cc:492] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac: Bootstrap starting.
I20260807 07:56:37.850986 29904 tablet_service.cc:1511] Processing CreateTablet for tablet 61189e76a3c848d693e6eed5cedc8b99 (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1789569705
I20260807 07:56:37.852270 29904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61189e76a3c848d693e6eed5cedc8b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.848636 30107 tablet_bootstrap.cc:654] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:37.866675 29903 tablet_service.cc:1511] Processing CreateTablet for tablet f29619c1ec0c4f0ba1995d9389666fdc (DEFAULT_TABLE table=test-workload [id=fcc5b3f4ee974cf2b5cce71aeaff47fd]), partition=RANGE (key) PARTITION 1789569705 <= VALUES
I20260807 07:56:37.868216 29903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f29619c1ec0c4f0ba1995d9389666fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:37.939260 30110 tablet_bootstrap.cc:492] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3: Bootstrap starting.
I20260807 07:56:37.945930 30110 tablet_bootstrap.cc:654] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:37.946753 30112 tablet_bootstrap.cc:492] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70: Bootstrap starting.
I20260807 07:56:37.960410 30107 tablet_bootstrap.cc:492] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac: No bootstrap required, opened a new log
I20260807 07:56:37.960446 30110 tablet_bootstrap.cc:492] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3: No bootstrap required, opened a new log
I20260807 07:56:37.960812 30112 tablet_bootstrap.cc:654] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:37.960942 30107 ts_tablet_manager.cc:1403] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac: Time spent bootstrapping tablet: real 0.119s user 0.043s sys 0.060s
I20260807 07:56:37.961054 30110 ts_tablet_manager.cc:1403] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.013s
I20260807 07:56:37.963287 30107 raft_consensus.cc:359] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:37.963848 30107 raft_consensus.cc:385] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:37.964221 30107 raft_consensus.cc:740] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da146479da477d9d1a1758f1f7a3ac, State: Initialized, Role: FOLLOWER
I20260807 07:56:37.963966 30110 raft_consensus.cc:359] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
W20260807 07:56:37.964582 29838 tablet.cc:2406] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 07:56:37.964895 30110 raft_consensus.cc:385] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:37.965358 30110 raft_consensus.cc:740] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f20fe56414c482e843f889d8ff335d3, State: Initialized, Role: FOLLOWER
I20260807 07:56:37.965184 30107 consensus_queue.cc:260] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:37.966656 30112 tablet_bootstrap.cc:492] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70: No bootstrap required, opened a new log
I20260807 07:56:37.966342 30110 consensus_queue.cc:260] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:37.967132 30112 ts_tablet_manager.cc:1403] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.009s
I20260807 07:56:37.967303 30107 ts_tablet_manager.cc:1434] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 07:56:37.968238 30107 tablet_bootstrap.cc:492] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac: Bootstrap starting.
I20260807 07:56:37.969907 30112 raft_consensus.cc:359] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } }
I20260807 07:56:37.970629 30112 raft_consensus.cc:385] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:37.970930 30112 raft_consensus.cc:740] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc25be82c34f42618ff8445be30e4c70, State: Initialized, Role: FOLLOWER
I20260807 07:56:37.971645 30112 consensus_queue.cc:260] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } }
I20260807 07:56:37.974440 30107 tablet_bootstrap.cc:654] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:37.980641 30112 ts_tablet_manager.cc:1434] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70: Time spent starting tablet: real 0.013s user 0.009s sys 0.003s
I20260807 07:56:37.981031 30081 heartbeater.cc:499] Master 127.27.64.190:34623 was elected leader, sending a full tablet report...
I20260807 07:56:37.981478 29958 heartbeater.cc:499] Master 127.27.64.190:34623 was elected leader, sending a full tablet report...
I20260807 07:56:37.982613 30110 ts_tablet_manager.cc:1434] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3: Time spent starting tablet: real 0.021s user 0.007s sys 0.012s
I20260807 07:56:37.982821 30112 tablet_bootstrap.cc:492] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70: Bootstrap starting.
I20260807 07:56:37.983821 30110 tablet_bootstrap.cc:492] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3: Bootstrap starting.
I20260807 07:56:37.988981 30112 tablet_bootstrap.cc:654] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:37.990274 30110 tablet_bootstrap.cc:654] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:37.992650 30107 tablet_bootstrap.cc:492] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac: No bootstrap required, opened a new log
I20260807 07:56:37.993175 30107 ts_tablet_manager.cc:1403] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.011s
I20260807 07:56:37.996753 30107 raft_consensus.cc:359] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:37.997843 30107 raft_consensus.cc:385] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:37.998196 30107 raft_consensus.cc:740] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da146479da477d9d1a1758f1f7a3ac, State: Initialized, Role: FOLLOWER
I20260807 07:56:37.998988 30107 consensus_queue.cc:260] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.001156 30107 ts_tablet_manager.cc:1434] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260807 07:56:38.002251 30107 tablet_bootstrap.cc:492] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac: Bootstrap starting.
I20260807 07:56:38.008397 30107 tablet_bootstrap.cc:654] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:38.031826 30107 tablet_bootstrap.cc:492] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac: No bootstrap required, opened a new log
I20260807 07:56:38.032061 30112 tablet_bootstrap.cc:492] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70: No bootstrap required, opened a new log
I20260807 07:56:38.032276 30107 ts_tablet_manager.cc:1403] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac: Time spent bootstrapping tablet: real 0.030s user 0.012s sys 0.015s
I20260807 07:56:38.032346 30110 tablet_bootstrap.cc:492] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3: No bootstrap required, opened a new log
I20260807 07:56:38.032593 30112 ts_tablet_manager.cc:1403] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70: Time spent bootstrapping tablet: real 0.050s user 0.030s sys 0.017s
I20260807 07:56:38.032918 30110 ts_tablet_manager.cc:1403] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3: Time spent bootstrapping tablet: real 0.049s user 0.020s sys 0.028s
I20260807 07:56:38.034756 30107 raft_consensus.cc:359] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.035279 30107 raft_consensus.cc:385] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:38.035509 30107 raft_consensus.cc:740] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da146479da477d9d1a1758f1f7a3ac, State: Initialized, Role: FOLLOWER
I20260807 07:56:38.035517 30112 raft_consensus.cc:359] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.036336 30112 raft_consensus.cc:385] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:38.036198 30107 consensus_queue.cc:260] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.036672 30112 raft_consensus.cc:740] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc25be82c34f42618ff8445be30e4c70, State: Initialized, Role: FOLLOWER
I20260807 07:56:38.035727 30110 raft_consensus.cc:359] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.037495 30110 raft_consensus.cc:385] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:38.037842 30110 raft_consensus.cc:740] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f20fe56414c482e843f889d8ff335d3, State: Initialized, Role: FOLLOWER
I20260807 07:56:38.037562 30112 consensus_queue.cc:260] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.038305 30107 ts_tablet_manager.cc:1434] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 07:56:38.038681 30110 consensus_queue.cc:260] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.039225 30107 tablet_bootstrap.cc:492] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac: Bootstrap starting.
I20260807 07:56:38.040720 30110 ts_tablet_manager.cc:1434] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260807 07:56:38.041647 30110 tablet_bootstrap.cc:492] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3: Bootstrap starting.
I20260807 07:56:38.045814 30107 tablet_bootstrap.cc:654] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:38.047806 30110 tablet_bootstrap.cc:654] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:38.049171 30112 ts_tablet_manager.cc:1434] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70: Time spent starting tablet: real 0.016s user 0.008s sys 0.000s
I20260807 07:56:38.052729 30112 tablet_bootstrap.cc:492] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70: Bootstrap starting.
I20260807 07:56:38.059149 30112 tablet_bootstrap.cc:654] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:38.059504 30110 tablet_bootstrap.cc:492] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3: No bootstrap required, opened a new log
I20260807 07:56:38.060017 30110 ts_tablet_manager.cc:1403] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.004s
I20260807 07:56:38.062974 30110 raft_consensus.cc:359] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.063992 30110 raft_consensus.cc:385] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:38.064308 30110 raft_consensus.cc:740] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f20fe56414c482e843f889d8ff335d3, State: Initialized, Role: FOLLOWER
I20260807 07:56:38.065105 30107 tablet_bootstrap.cc:492] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac: No bootstrap required, opened a new log
I20260807 07:56:38.065644 30107 ts_tablet_manager.cc:1403] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac: Time spent bootstrapping tablet: real 0.027s user 0.015s sys 0.007s
I20260807 07:56:38.065064 30110 consensus_queue.cc:260] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.067517 30110 ts_tablet_manager.cc:1434] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3: Time spent starting tablet: real 0.007s user 0.002s sys 0.002s
I20260807 07:56:38.068500 30110 tablet_bootstrap.cc:492] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3: Bootstrap starting.
I20260807 07:56:38.068480 30107 raft_consensus.cc:359] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } }
I20260807 07:56:38.069303 30107 raft_consensus.cc:385] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:38.069674 30107 raft_consensus.cc:740] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da146479da477d9d1a1758f1f7a3ac, State: Initialized, Role: FOLLOWER
I20260807 07:56:38.070443 30107 consensus_queue.cc:260] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } }
I20260807 07:56:38.071947 30112 tablet_bootstrap.cc:492] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70: No bootstrap required, opened a new log
I20260807 07:56:38.072432 30112 ts_tablet_manager.cc:1403] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.003s
I20260807 07:56:38.072602 30107 ts_tablet_manager.cc:1434] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260807 07:56:38.074067 30107 tablet_bootstrap.cc:492] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac: Bootstrap starting.
I20260807 07:56:38.075512 30110 tablet_bootstrap.cc:654] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:38.075371 30112 raft_consensus.cc:359] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.076087 30112 raft_consensus.cc:385] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:38.076570 30112 raft_consensus.cc:740] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc25be82c34f42618ff8445be30e4c70, State: Initialized, Role: FOLLOWER
I20260807 07:56:38.075596 30109 raft_consensus.cc:493] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:38.077443 30112 consensus_queue.cc:260] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.077626 30109 raft_consensus.cc:515] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.080505 30107 tablet_bootstrap.cc:654] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:38.076000 30117 raft_consensus.cc:493] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:38.086338 30112 ts_tablet_manager.cc:1434] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70: Time spent starting tablet: real 0.014s user 0.004s sys 0.004s
I20260807 07:56:38.086119 30117 raft_consensus.cc:515] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.087548 30112 tablet_bootstrap.cc:492] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70: Bootstrap starting.
I20260807 07:56:38.091807 30117 leader_election.cc:290] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129:45511), cc25be82c34f42618ff8445be30e4c70 (127.27.64.130:43161)
I20260807 07:56:38.094434 30112 tablet_bootstrap.cc:654] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:38.093478 30110 tablet_bootstrap.cc:492] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3: No bootstrap required, opened a new log
I20260807 07:56:38.097851 30110 ts_tablet_manager.cc:1403] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3: Time spent bootstrapping tablet: real 0.030s user 0.013s sys 0.011s
I20260807 07:56:38.100931 30110 raft_consensus.cc:359] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } }
I20260807 07:56:38.101974 30110 raft_consensus.cc:385] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:38.102281 30110 raft_consensus.cc:740] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f20fe56414c482e843f889d8ff335d3, State: Initialized, Role: FOLLOWER
I20260807 07:56:38.103011 30110 consensus_queue.cc:260] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } }
I20260807 07:56:38.105556 30110 ts_tablet_manager.cc:1434] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260807 07:56:38.106494 30110 tablet_bootstrap.cc:492] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3: Bootstrap starting.
I20260807 07:56:38.113173 29922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce70ac8492c4e3eaa7dbc4b245ff835" candidate_uuid: "5f20fe56414c482e843f889d8ff335d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc25be82c34f42618ff8445be30e4c70" is_pre_election: true
I20260807 07:56:38.113911 29922 raft_consensus.cc:2468] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f20fe56414c482e843f889d8ff335d3 in term 0.
I20260807 07:56:38.114166 30110 tablet_bootstrap.cc:654] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:38.115232 30109 leader_election.cc:290] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc25be82c34f42618ff8445be30e4c70 (127.27.64.130:43161), 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243)
I20260807 07:56:38.115351 29985 leader_election.cc:304] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f20fe56414c482e843f889d8ff335d3, cc25be82c34f42618ff8445be30e4c70; no voters:
I20260807 07:56:38.116163 30117 raft_consensus.cc:2804] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:38.116513 30117 raft_consensus.cc:493] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:38.116875 30117 raft_consensus.cc:3060] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.118954 30112 tablet_bootstrap.cc:492] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70: No bootstrap required, opened a new log
I20260807 07:56:38.119500 30112 ts_tablet_manager.cc:1403] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.007s
I20260807 07:56:38.122589 30112 raft_consensus.cc:359] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.123318 30112 raft_consensus.cc:385] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:38.123600 30112 raft_consensus.cc:740] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc25be82c34f42618ff8445be30e4c70, State: Initialized, Role: FOLLOWER
I20260807 07:56:38.123737 30117 raft_consensus.cc:515] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.124511 30112 consensus_queue.cc:260] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.127082 30112 ts_tablet_manager.cc:1434] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260807 07:56:38.127130 29922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce70ac8492c4e3eaa7dbc4b245ff835" candidate_uuid: "5f20fe56414c482e843f889d8ff335d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc25be82c34f42618ff8445be30e4c70"
I20260807 07:56:38.127815 29922 raft_consensus.cc:3060] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.128175 30112 tablet_bootstrap.cc:492] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70: Bootstrap starting.
I20260807 07:56:38.134816 29922 raft_consensus.cc:2468] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f20fe56414c482e843f889d8ff335d3 in term 1.
I20260807 07:56:38.136185 29985 leader_election.cc:304] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f20fe56414c482e843f889d8ff335d3, cc25be82c34f42618ff8445be30e4c70; no voters:
I20260807 07:56:38.137321 30120 raft_consensus.cc:493] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:38.137660 30117 leader_election.cc:290] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [CANDIDATE]: Term 1 election: Requested vote from peers 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129:45511), cc25be82c34f42618ff8445be30e4c70 (127.27.64.130:43161)
I20260807 07:56:38.137826 30120 raft_consensus.cc:515] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.138599 30117 raft_consensus.cc:2804] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:38.139047 30117 raft_consensus.cc:697] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 1 LEADER]: Becoming Leader. State: Replica: 5f20fe56414c482e843f889d8ff335d3, State: Running, Role: LEADER
I20260807 07:56:38.141896 30112 tablet_bootstrap.cc:654] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:38.143314 30120 leader_election.cc:290] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129:45511), 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243)
I20260807 07:56:38.139830 30117 consensus_queue.cc:237] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.164435 30152 raft_consensus.cc:493] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:38.165001 30152 raft_consensus.cc:515] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.174866 30152 leader_election.cc:290] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129:45511), cc25be82c34f42618ff8445be30e4c70 (127.27.64.130:43161)
I20260807 07:56:38.176956 29922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189e76a3c848d693e6eed5cedc8b99" candidate_uuid: "5f20fe56414c482e843f889d8ff335d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc25be82c34f42618ff8445be30e4c70" is_pre_election: true
W20260807 07:56:38.179430 29985 leader_election.cc:343] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc25be82c34f42618ff8445be30e4c70 (127.27.64.130:43161): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:38.187428 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a024f0de4f4bff825cf96716d3b59a" candidate_uuid: "cc25be82c34f42618ff8445be30e4c70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f20fe56414c482e843f889d8ff335d3" is_pre_election: true
I20260807 07:56:38.188495 30109 raft_consensus.cc:493] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:38.189051 30109 raft_consensus.cc:515] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } }
W20260807 07:56:38.191177 29868 leader_election.cc:343] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:38.191444 30109 leader_election.cc:290] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243), cc25be82c34f42618ff8445be30e4c70 (127.27.64.130:43161)
I20260807 07:56:38.201822 29790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a024f0de4f4bff825cf96716d3b59a" candidate_uuid: "cc25be82c34f42618ff8445be30e4c70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da146479da477d9d1a1758f1f7a3ac" is_pre_election: true
I20260807 07:56:38.202543 29790 raft_consensus.cc:2468] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc25be82c34f42618ff8445be30e4c70 in term 0.
I20260807 07:56:38.206529 29636 catalog_manager.cc:5697] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131). New cstate: current_term: 1 leader_uuid: "5f20fe56414c482e843f889d8ff335d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:38.217692 30112 tablet_bootstrap.cc:492] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70: No bootstrap required, opened a new log
I20260807 07:56:38.218253 30112 ts_tablet_manager.cc:1403] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70: Time spent bootstrapping tablet: real 0.090s user 0.030s sys 0.000s
I20260807 07:56:38.219609 29788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189e76a3c848d693e6eed5cedc8b99" candidate_uuid: "5f20fe56414c482e843f889d8ff335d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da146479da477d9d1a1758f1f7a3ac" is_pre_election: true
I20260807 07:56:38.224226 29789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce70ac8492c4e3eaa7dbc4b245ff835" candidate_uuid: "5f20fe56414c482e843f889d8ff335d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da146479da477d9d1a1758f1f7a3ac"
I20260807 07:56:38.225235 29789 raft_consensus.cc:3060] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.226536 30107 tablet_bootstrap.cc:492] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac: No bootstrap required, opened a new log
I20260807 07:56:38.227065 30107 ts_tablet_manager.cc:1403] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac: Time spent bootstrapping tablet: real 0.154s user 0.028s sys 0.096s
I20260807 07:56:38.230017 29790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce70ac8492c4e3eaa7dbc4b245ff835" candidate_uuid: "5f20fe56414c482e843f889d8ff335d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da146479da477d9d1a1758f1f7a3ac" is_pre_election: true
I20260807 07:56:38.230556 30112 raft_consensus.cc:359] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.230756 30107 raft_consensus.cc:359] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.231304 30112 raft_consensus.cc:385] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:38.231575 30107 raft_consensus.cc:385] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:38.231758 30112 raft_consensus.cc:740] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc25be82c34f42618ff8445be30e4c70, State: Initialized, Role: FOLLOWER
I20260807 07:56:38.231968 30107 raft_consensus.cc:740] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50da146479da477d9d1a1758f1f7a3ac, State: Initialized, Role: FOLLOWER
I20260807 07:56:38.232733 30107 consensus_queue.cc:260] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.234576 29865 leader_election.cc:304] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50da146479da477d9d1a1758f1f7a3ac, cc25be82c34f42618ff8445be30e4c70; no voters: 5f20fe56414c482e843f889d8ff335d3
I20260807 07:56:38.235400 30120 raft_consensus.cc:2804] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:38.235772 30120 raft_consensus.cc:493] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:38.232827 30112 consensus_queue.cc:260] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.236122 30107 ts_tablet_manager.cc:1434] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac: Time spent starting tablet: real 0.009s user 0.005s sys 0.003s
I20260807 07:56:38.236122 30120 raft_consensus.cc:3060] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Advancing to term 1
W20260807 07:56:38.239015 29985 leader_election.cc:343] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:38.240103 29985 leader_election.cc:304] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f20fe56414c482e843f889d8ff335d3; no voters: 50da146479da477d9d1a1758f1f7a3ac, cc25be82c34f42618ff8445be30e4c70
I20260807 07:56:38.240862 30117 raft_consensus.cc:2749] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:38.244760 30112 ts_tablet_manager.cc:1434] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70: Time spent starting tablet: real 0.026s user 0.007s sys 0.001s
I20260807 07:56:38.245791 30112 tablet_bootstrap.cc:492] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70: Bootstrap starting.
I20260807 07:56:38.251230 29922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29619c1ec0c4f0ba1995d9389666fdc" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc25be82c34f42618ff8445be30e4c70" is_pre_election: true
I20260807 07:56:38.251883 29922 raft_consensus.cc:2468] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 0.
I20260807 07:56:38.253772 29922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7e0974a32c4f3badc1a64cff604134" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc25be82c34f42618ff8445be30e4c70" is_pre_election: true
I20260807 07:56:38.254405 29922 raft_consensus.cc:2468] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 0.
I20260807 07:56:38.254695 29789 raft_consensus.cc:2468] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f20fe56414c482e843f889d8ff335d3 in term 1.
I20260807 07:56:38.255492 29740 leader_election.cc:304] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50da146479da477d9d1a1758f1f7a3ac, cc25be82c34f42618ff8445be30e4c70; no voters:
I20260807 07:56:38.256327 30109 raft_consensus.cc:2804] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:38.256686 30109 raft_consensus.cc:493] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:38.257018 30109 raft_consensus.cc:3060] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.256529 29740 leader_election.cc:304] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50da146479da477d9d1a1758f1f7a3ac, cc25be82c34f42618ff8445be30e4c70; no voters:
I20260807 07:56:38.251904 30112 tablet_bootstrap.cc:654] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:38.261252 30155 raft_consensus.cc:2804] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:38.261765 30155 raft_consensus.cc:493] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:38.262151 30155 raft_consensus.cc:3060] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.262271 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7e0974a32c4f3badc1a64cff604134" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f20fe56414c482e843f889d8ff335d3" is_pre_election: true
I20260807 07:56:38.263036 30036 raft_consensus.cc:2468] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 0.
I20260807 07:56:38.261292 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29619c1ec0c4f0ba1995d9389666fdc" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f20fe56414c482e843f889d8ff335d3" is_pre_election: true
I20260807 07:56:38.264780 30037 raft_consensus.cc:2468] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 0.
I20260807 07:56:38.270618 30110 tablet_bootstrap.cc:492] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3: No bootstrap required, opened a new log
I20260807 07:56:38.271142 30110 ts_tablet_manager.cc:1403] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3: Time spent bootstrapping tablet: real 0.165s user 0.031s sys 0.048s
I20260807 07:56:38.271032 30109 raft_consensus.cc:515] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.271735 30155 raft_consensus.cc:515] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } }
I20260807 07:56:38.273367 29922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29619c1ec0c4f0ba1995d9389666fdc" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc25be82c34f42618ff8445be30e4c70"
I20260807 07:56:38.273932 29922 raft_consensus.cc:3060] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.274034 30120 raft_consensus.cc:515] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.274132 30110 raft_consensus.cc:359] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.274535 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7e0974a32c4f3badc1a64cff604134" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f20fe56414c482e843f889d8ff335d3"
I20260807 07:56:38.274873 30110 raft_consensus.cc:385] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:38.275022 30037 raft_consensus.cc:3060] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.276794 29789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a024f0de4f4bff825cf96716d3b59a" candidate_uuid: "cc25be82c34f42618ff8445be30e4c70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da146479da477d9d1a1758f1f7a3ac"
I20260807 07:56:38.277364 29789 raft_consensus.cc:3060] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.277747 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a024f0de4f4bff825cf96716d3b59a" candidate_uuid: "cc25be82c34f42618ff8445be30e4c70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f20fe56414c482e843f889d8ff335d3"
I20260807 07:56:38.278120 30155 leader_election.cc:290] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 1 election: Requested vote from peers 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243), cc25be82c34f42618ff8445be30e4c70 (127.27.64.130:43161)
W20260807 07:56:38.279119 29868 leader_election.cc:343] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:38.277495 30120 leader_election.cc:290] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [CANDIDATE]: Term 1 election: Requested vote from peers 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129:45511), 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243)
I20260807 07:56:38.280319 29922 raft_consensus.cc:2468] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 1.
I20260807 07:56:38.275198 30110 raft_consensus.cc:740] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f20fe56414c482e843f889d8ff335d3, State: Initialized, Role: FOLLOWER
I20260807 07:56:38.281562 29740 leader_election.cc:304] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50da146479da477d9d1a1758f1f7a3ac, cc25be82c34f42618ff8445be30e4c70; no voters:
I20260807 07:56:38.282244 30155 raft_consensus.cc:2804] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:38.282274 30110 consensus_queue.cc:260] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.283177 29789 raft_consensus.cc:2468] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc25be82c34f42618ff8445be30e4c70 in term 1.
I20260807 07:56:38.284312 29865 leader_election.cc:304] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50da146479da477d9d1a1758f1f7a3ac, cc25be82c34f42618ff8445be30e4c70; no voters: 5f20fe56414c482e843f889d8ff335d3
I20260807 07:56:38.285537 30120 raft_consensus.cc:2804] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:38.286670 30120 raft_consensus.cc:697] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 1 LEADER]: Becoming Leader. State: Replica: cc25be82c34f42618ff8445be30e4c70, State: Running, Role: LEADER
I20260807 07:56:38.287477 30120 consensus_queue.cc:237] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.289557 29922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7e0974a32c4f3badc1a64cff604134" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc25be82c34f42618ff8445be30e4c70"
I20260807 07:56:38.290179 29922 raft_consensus.cc:3060] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.291491 30110 ts_tablet_manager.cc:1434] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20260807 07:56:38.292737 30155 raft_consensus.cc:697] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [term 1 LEADER]: Becoming Leader. State: Replica: 50da146479da477d9d1a1758f1f7a3ac, State: Running, Role: LEADER
I20260807 07:56:38.293680 30155 consensus_queue.cc:237] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.295107 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f29619c1ec0c4f0ba1995d9389666fdc" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f20fe56414c482e843f889d8ff335d3"
I20260807 07:56:38.295657 30036 raft_consensus.cc:3060] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.300904 30110 tablet_bootstrap.cc:492] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3: Bootstrap starting.
I20260807 07:56:38.301455 30112 tablet_bootstrap.cc:492] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70: No bootstrap required, opened a new log
I20260807 07:56:38.301973 30112 ts_tablet_manager.cc:1403] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70: Time spent bootstrapping tablet: real 0.056s user 0.013s sys 0.004s
W20260807 07:56:38.303833 29707 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:56:38.306200 30036 raft_consensus.cc:2468] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 1.
I20260807 07:56:38.307686 30109 leader_election.cc:290] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 1 election: Requested vote from peers cc25be82c34f42618ff8445be30e4c70 (127.27.64.130:43161), 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243)
I20260807 07:56:38.290445 30037 raft_consensus.cc:2468] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 1.
I20260807 07:56:38.310138 29741 leader_election.cc:304] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50da146479da477d9d1a1758f1f7a3ac, 5f20fe56414c482e843f889d8ff335d3; no voters:
I20260807 07:56:38.311221 30109 raft_consensus.cc:2804] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:38.311800 30110 tablet_bootstrap.cc:654] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:38.305065 30112 raft_consensus.cc:359] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.313884 30112 raft_consensus.cc:385] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:38.314194 30112 raft_consensus.cc:740] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc25be82c34f42618ff8445be30e4c70, State: Initialized, Role: FOLLOWER
I20260807 07:56:38.315876 29922 raft_consensus.cc:2468] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 1.
I20260807 07:56:38.311889 30109 raft_consensus.cc:697] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [term 1 LEADER]: Becoming Leader. State: Replica: 50da146479da477d9d1a1758f1f7a3ac, State: Running, Role: LEADER
I20260807 07:56:38.317340 30112 consensus_queue.cc:260] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.318497 30109 consensus_queue.cc:237] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } }
I20260807 07:56:38.319634 30112 ts_tablet_manager.cc:1434] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70: Time spent starting tablet: real 0.017s user 0.003s sys 0.003s
I20260807 07:56:38.320619 29636 catalog_manager.cc:5697] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc25be82c34f42618ff8445be30e4c70 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "cc25be82c34f42618ff8445be30e4c70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:38.327306 29635 catalog_manager.cc:5697] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129). New cstate: current_term: 1 leader_uuid: "50da146479da477d9d1a1758f1f7a3ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:38.331629 30110 tablet_bootstrap.cc:492] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3: No bootstrap required, opened a new log
I20260807 07:56:38.332109 30110 ts_tablet_manager.cc:1403] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3: Time spent bootstrapping tablet: real 0.031s user 0.010s sys 0.006s
I20260807 07:56:38.334977 30110 raft_consensus.cc:359] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.335652 30110 raft_consensus.cc:385] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:38.335942 30110 raft_consensus.cc:740] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f20fe56414c482e843f889d8ff335d3, State: Initialized, Role: FOLLOWER
I20260807 07:56:38.336649 30110 consensus_queue.cc:260] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.340314 30110 ts_tablet_manager.cc:1434] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260807 07:56:38.342576 29631 catalog_manager.cc:5697] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129). New cstate: current_term: 1 leader_uuid: "50da146479da477d9d1a1758f1f7a3ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:38.393699 30109 raft_consensus.cc:493] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:38.394213 30109 raft_consensus.cc:515] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.396044 30109 leader_election.cc:290] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc25be82c34f42618ff8445be30e4c70 (127.27.64.130:43161), 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243)
I20260807 07:56:38.397118 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94516c5a3e66456688417841a07abf62" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f20fe56414c482e843f889d8ff335d3" is_pre_election: true
I20260807 07:56:38.397505 29922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94516c5a3e66456688417841a07abf62" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc25be82c34f42618ff8445be30e4c70" is_pre_election: true
I20260807 07:56:38.397691 30037 raft_consensus.cc:2468] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 0.
I20260807 07:56:38.398077 29922 raft_consensus.cc:2468] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 0.
I20260807 07:56:38.398716 29741 leader_election.cc:304] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50da146479da477d9d1a1758f1f7a3ac, 5f20fe56414c482e843f889d8ff335d3; no voters:
I20260807 07:56:38.399363 30109 raft_consensus.cc:2804] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:38.399703 30109 raft_consensus.cc:493] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:38.399926 30109 raft_consensus.cc:3060] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.404819 30109 raft_consensus.cc:515] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.406308 30109 leader_election.cc:290] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 1 election: Requested vote from peers cc25be82c34f42618ff8445be30e4c70 (127.27.64.130:43161), 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243)
I20260807 07:56:38.407151 29922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94516c5a3e66456688417841a07abf62" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc25be82c34f42618ff8445be30e4c70"
I20260807 07:56:38.407392 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94516c5a3e66456688417841a07abf62" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f20fe56414c482e843f889d8ff335d3"
I20260807 07:56:38.407721 29922 raft_consensus.cc:3060] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.407887 30037 raft_consensus.cc:3060] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.412420 30037 raft_consensus.cc:2468] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 1.
I20260807 07:56:38.412420 29922 raft_consensus.cc:2468] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 1.
I20260807 07:56:38.413498 29741 leader_election.cc:304] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50da146479da477d9d1a1758f1f7a3ac, 5f20fe56414c482e843f889d8ff335d3; no voters:
I20260807 07:56:38.414139 30109 raft_consensus.cc:2804] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:38.414580 30109 raft_consensus.cc:697] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 1 LEADER]: Becoming Leader. State: Replica: 50da146479da477d9d1a1758f1f7a3ac, State: Running, Role: LEADER
I20260807 07:56:38.415191 30109 consensus_queue.cc:237] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.421695 29631 catalog_manager.cc:5697] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129). New cstate: current_term: 1 leader_uuid: "50da146479da477d9d1a1758f1f7a3ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:38.448429 30120 raft_consensus.cc:493] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:38.448899 30120 raft_consensus.cc:515] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.450662 30120 leader_election.cc:290] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129:45511), 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243)
I20260807 07:56:38.451453 29789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189e76a3c848d693e6eed5cedc8b99" candidate_uuid: "cc25be82c34f42618ff8445be30e4c70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da146479da477d9d1a1758f1f7a3ac" is_pre_election: true
I20260807 07:56:38.451694 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189e76a3c848d693e6eed5cedc8b99" candidate_uuid: "cc25be82c34f42618ff8445be30e4c70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f20fe56414c482e843f889d8ff335d3" is_pre_election: true
I20260807 07:56:38.451963 29789 raft_consensus.cc:2468] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc25be82c34f42618ff8445be30e4c70 in term 0.
I20260807 07:56:38.452239 30037 raft_consensus.cc:2468] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc25be82c34f42618ff8445be30e4c70 in term 0.
I20260807 07:56:38.452907 29865 leader_election.cc:304] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50da146479da477d9d1a1758f1f7a3ac, cc25be82c34f42618ff8445be30e4c70; no voters:
I20260807 07:56:38.453622 30120 raft_consensus.cc:2804] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:38.453946 30120 raft_consensus.cc:493] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:38.454159 30120 raft_consensus.cc:3060] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.458618 30120 raft_consensus.cc:515] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.460300 30120 leader_election.cc:290] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [CANDIDATE]: Term 1 election: Requested vote from peers 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129:45511), 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243)
I20260807 07:56:38.460937 29789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189e76a3c848d693e6eed5cedc8b99" candidate_uuid: "cc25be82c34f42618ff8445be30e4c70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da146479da477d9d1a1758f1f7a3ac"
I20260807 07:56:38.461254 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61189e76a3c848d693e6eed5cedc8b99" candidate_uuid: "cc25be82c34f42618ff8445be30e4c70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f20fe56414c482e843f889d8ff335d3"
I20260807 07:56:38.461520 29789 raft_consensus.cc:3060] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.461831 30037 raft_consensus.cc:3060] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.468123 29789 raft_consensus.cc:2468] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc25be82c34f42618ff8445be30e4c70 in term 1.
I20260807 07:56:38.468124 30037 raft_consensus.cc:2468] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc25be82c34f42618ff8445be30e4c70 in term 1.
I20260807 07:56:38.469409 29868 leader_election.cc:304] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f20fe56414c482e843f889d8ff335d3, cc25be82c34f42618ff8445be30e4c70; no voters:
I20260807 07:56:38.470111 30120 raft_consensus.cc:2804] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:38.470513 30120 raft_consensus.cc:697] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 1 LEADER]: Becoming Leader. State: Replica: cc25be82c34f42618ff8445be30e4c70, State: Running, Role: LEADER
I20260807 07:56:38.471243 30120 consensus_queue.cc:237] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.477474 29631 catalog_manager.cc:5697] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc25be82c34f42618ff8445be30e4c70 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "cc25be82c34f42618ff8445be30e4c70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:38.666029 30117 raft_consensus.cc:493] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:38.666553 30117 raft_consensus.cc:515] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.668305 30117 leader_election.cc:290] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129:45511), cc25be82c34f42618ff8445be30e4c70 (127.27.64.130:43161)
I20260807 07:56:38.669106 29789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a024f0de4f4bff825cf96716d3b59a" candidate_uuid: "5f20fe56414c482e843f889d8ff335d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50da146479da477d9d1a1758f1f7a3ac" is_pre_election: true
I20260807 07:56:38.669549 29922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a024f0de4f4bff825cf96716d3b59a" candidate_uuid: "5f20fe56414c482e843f889d8ff335d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc25be82c34f42618ff8445be30e4c70" is_pre_election: true
I20260807 07:56:38.669878 29789 raft_consensus.cc:2393] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f20fe56414c482e843f889d8ff335d3 in current term 1: Already voted for candidate cc25be82c34f42618ff8445be30e4c70 in this term.
I20260807 07:56:38.671253 29985 leader_election.cc:304] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f20fe56414c482e843f889d8ff335d3; no voters: 50da146479da477d9d1a1758f1f7a3ac, cc25be82c34f42618ff8445be30e4c70
I20260807 07:56:38.672202 30117 raft_consensus.cc:3060] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:38.674356 30037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ce70ac8492c4e3eaa7dbc4b245ff835"
dest_uuid: "5f20fe56414c482e843f889d8ff335d3"
mode: GRACEFUL
new_leader_uuid: "50da146479da477d9d1a1758f1f7a3ac"
from {username='slave'} at 127.0.0.1:59800
I20260807 07:56:38.674993 30037 raft_consensus.cc:606] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 1 LEADER]: Received request to transfer leadership to TS 50da146479da477d9d1a1758f1f7a3ac
I20260807 07:56:38.677856 30117 raft_consensus.cc:2749] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:38.687640 29922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51a024f0de4f4bff825cf96716d3b59a"
dest_uuid: "cc25be82c34f42618ff8445be30e4c70"
mode: GRACEFUL
new_leader_uuid: "50da146479da477d9d1a1758f1f7a3ac"
from {username='slave'} at 127.0.0.1:40154
I20260807 07:56:38.688192 29922 raft_consensus.cc:606] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 1 LEADER]: Received request to transfer leadership to TS 50da146479da477d9d1a1758f1f7a3ac
I20260807 07:56:38.693296 29922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61189e76a3c848d693e6eed5cedc8b99"
dest_uuid: "cc25be82c34f42618ff8445be30e4c70"
mode: GRACEFUL
new_leader_uuid: "50da146479da477d9d1a1758f1f7a3ac"
from {username='slave'} at 127.0.0.1:40154
I20260807 07:56:38.693794 29922 raft_consensus.cc:606] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 1 LEADER]: Received request to transfer leadership to TS 50da146479da477d9d1a1758f1f7a3ac
I20260807 07:56:38.702030 30109 consensus_queue.cc:1048] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:38.724340 30155 consensus_queue.cc:1048] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:38.731205 30117 consensus_queue.cc:1048] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:38.738472 30117 consensus_queue.cc:1048] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:38.753564 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:56:38.759289 30175 raft_consensus.cc:993] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3: : Instructing follower 50da146479da477d9d1a1758f1f7a3ac to start an election
W20260807 07:56:38.759783 27906 auto_leader_rebalancer.cc:456] leader transfer for tablet 6d7e0974a32c4f3badc1a64cff604134 from 50da146479da477d9d1a1758f1f7a3ac to 5f20fe56414c482e843f889d8ff335d3 failed: Service unavailable: TEST: forced leader step-down failure
I20260807 07:56:38.759792 30175 raft_consensus.cc:1081] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 1 LEADER]: Signalling peer 50da146479da477d9d1a1758f1f7a3ac to start an election
I20260807 07:56:38.763159 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:56:38.764727 29789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ce70ac8492c4e3eaa7dbc4b245ff835"
dest_uuid: "50da146479da477d9d1a1758f1f7a3ac"
from {username='slave'} at 127.0.0.1:56394
I20260807 07:56:38.764956 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:56:38.765333 29789 raft_consensus.cc:493] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:56:38.765978 29789 raft_consensus.cc:3060] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:38.765630 27906 tablet_server.cc:179] TabletServer@127.27.64.129:0 shutting down...
I20260807 07:56:38.774334 29789 raft_consensus.cc:515] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.776935 29789 leader_election.cc:290] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 2 election: Requested vote from peers cc25be82c34f42618ff8445be30e4c70 (127.27.64.130:43161), 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131:46243)
I20260807 07:56:38.778033 30037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce70ac8492c4e3eaa7dbc4b245ff835" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f20fe56414c482e843f889d8ff335d3"
I20260807 07:56:38.779170 29922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce70ac8492c4e3eaa7dbc4b245ff835" candidate_uuid: "50da146479da477d9d1a1758f1f7a3ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc25be82c34f42618ff8445be30e4c70"
I20260807 07:56:38.779449 30037 raft_consensus.cc:3055] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:56:38.780006 29922 raft_consensus.cc:3060] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:38.780189 30037 raft_consensus.cc:740] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f20fe56414c482e843f889d8ff335d3, State: Running, Role: LEADER
I20260807 07:56:38.781034 30037 consensus_queue.cc:260] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.782081 30037 raft_consensus.cc:3060] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:56:38.782390 30155 consensus_queue.cc:1048] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:38.785892 29922 raft_consensus.cc:2468] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 2.
I20260807 07:56:38.787083 29740 leader_election.cc:304] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50da146479da477d9d1a1758f1f7a3ac, cc25be82c34f42618ff8445be30e4c70; no voters:
I20260807 07:56:38.787853 30155 raft_consensus.cc:2804] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:56:38.788098 30037 raft_consensus.cc:2468] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50da146479da477d9d1a1758f1f7a3ac in term 2.
I20260807 07:56:38.788326 30155 raft_consensus.cc:697] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [term 2 LEADER]: Becoming Leader. State: Replica: 50da146479da477d9d1a1758f1f7a3ac, State: Running, Role: LEADER
I20260807 07:56:38.789281 30155 consensus_queue.cc:237] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } }
I20260807 07:56:38.801895 29631 catalog_manager.cc:5697] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac reported cstate change: term changed from 1 to 2, leader changed from 5f20fe56414c482e843f889d8ff335d3 (127.27.64.131) to 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129). New cstate: current_term: 2 leader_uuid: "50da146479da477d9d1a1758f1f7a3ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50da146479da477d9d1a1758f1f7a3ac" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc25be82c34f42618ff8445be30e4c70" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 43161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:38.803557 30155 consensus_queue.cc:1048] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:38.824304 27906 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260807 07:56:38.824965 27906 tablet_replica.cc:333] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac: stopping tablet replica
I20260807 07:56:38.825770 27906 raft_consensus.cc:2243] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:56:38.826740 27906 raft_consensus.cc:2272] T 6d7e0974a32c4f3badc1a64cff604134 P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.829082 27906 tablet_replica.cc:333] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac: stopping tablet replica
I20260807 07:56:38.829658 27906 raft_consensus.cc:2243] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:56:38.830335 27906 raft_consensus.cc:2272] T f29619c1ec0c4f0ba1995d9389666fdc P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.832465 27906 tablet_replica.cc:333] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac: stopping tablet replica
W20260807 07:56:38.832821 29865 consensus_peers.cc:597] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 -> Peer 50da146479da477d9d1a1758f1f7a3ac (127.27.64.129:45511): Couldn't send request to peer 50da146479da477d9d1a1758f1f7a3ac. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:38.833099 27906 raft_consensus.cc:2243] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:38.833551 27906 raft_consensus.cc:2272] T 51a024f0de4f4bff825cf96716d3b59a P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.834976 27906 tablet_replica.cc:333] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac: stopping tablet replica
I20260807 07:56:38.835414 27906 raft_consensus.cc:2243] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:56:38.835868 27906 pending_rounds.cc:70] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac: Trying to abort 1 pending ops.
I20260807 07:56:38.836068 27906 pending_rounds.cc:77] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315822175915163648 op_type: NO_OP noop_request { }
I20260807 07:56:38.836365 27906 raft_consensus.cc:2889] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260807 07:56:38.836580 27906 raft_consensus.cc:2272] T 94516c5a3e66456688417841a07abf62 P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.838369 27906 tablet_replica.cc:333] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac: stopping tablet replica
I20260807 07:56:38.838778 27906 raft_consensus.cc:2243] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:38.839063 27906 raft_consensus.cc:2272] T 61189e76a3c848d693e6eed5cedc8b99 P 50da146479da477d9d1a1758f1f7a3ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.840346 27906 tablet_replica.cc:333] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac: stopping tablet replica
I20260807 07:56:38.840736 27906 raft_consensus.cc:2243] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [term 2 LEADER]: Raft consensus shutting down.
I20260807 07:56:38.841220 27906 pending_rounds.cc:70] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac: Trying to abort 1 pending ops.
I20260807 07:56:38.841430 27906 pending_rounds.cc:77] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7315822177449717760 op_type: NO_OP noop_request { }
I20260807 07:56:38.841689 27906 raft_consensus.cc:2889] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260807 07:56:38.841943 27906 raft_consensus.cc:2272] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 50da146479da477d9d1a1758f1f7a3ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.864784 27906 tablet_server.cc:196] TabletServer@127.27.64.129:0 shutdown complete.
I20260807 07:56:38.870795 30120 consensus_queue.cc:1048] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f20fe56414c482e843f889d8ff335d3" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 46243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:38.880311 27906 tablet_server.cc:179] TabletServer@127.27.64.130:0 shutting down...
I20260807 07:56:38.900133 27906 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260807 07:56:38.900753 27906 tablet_replica.cc:333] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70: stopping tablet replica
I20260807 07:56:38.901320 27906 raft_consensus.cc:2243] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:38.901791 27906 raft_consensus.cc:2272] T f29619c1ec0c4f0ba1995d9389666fdc P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.903852 27906 tablet_replica.cc:333] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70: stopping tablet replica
I20260807 07:56:38.904340 27906 raft_consensus.cc:2243] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:38.904675 27906 raft_consensus.cc:2272] T 94516c5a3e66456688417841a07abf62 P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.906129 27906 tablet_replica.cc:333] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70: stopping tablet replica
I20260807 07:56:38.906580 27906 raft_consensus.cc:2243] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:56:38.907083 27906 pending_rounds.cc:70] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70: Trying to abort 1 pending ops.
I20260807 07:56:38.907243 27906 pending_rounds.cc:77] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315822176144822272 op_type: NO_OP noop_request { }
I20260807 07:56:38.907478 27906 raft_consensus.cc:2889] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260807 07:56:38.907722 27906 raft_consensus.cc:2272] T 61189e76a3c848d693e6eed5cedc8b99 P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.909446 27906 tablet_replica.cc:333] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70: stopping tablet replica
I20260807 07:56:38.909945 27906 raft_consensus.cc:2243] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:38.910302 27906 raft_consensus.cc:2272] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P cc25be82c34f42618ff8445be30e4c70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.912628 27906 tablet_replica.cc:333] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70: stopping tablet replica
I20260807 07:56:38.913038 27906 raft_consensus.cc:2243] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:56:38.913733 27906 raft_consensus.cc:2272] T 51a024f0de4f4bff825cf96716d3b59a P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.915509 27906 tablet_replica.cc:333] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70: stopping tablet replica
I20260807 07:56:38.915897 27906 raft_consensus.cc:2243] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:38.916216 27906 raft_consensus.cc:2272] T 6d7e0974a32c4f3badc1a64cff604134 P cc25be82c34f42618ff8445be30e4c70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.939203 27906 tablet_server.cc:196] TabletServer@127.27.64.130:0 shutdown complete.
I20260807 07:56:38.950515 27906 tablet_server.cc:179] TabletServer@127.27.64.131:0 shutting down...
I20260807 07:56:38.966037 27906 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260807 07:56:38.966675 27906 tablet_replica.cc:333] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3: stopping tablet replica
I20260807 07:56:38.967432 27906 raft_consensus.cc:2243] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:38.967866 27906 raft_consensus.cc:2272] T 51a024f0de4f4bff825cf96716d3b59a P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.969856 27906 tablet_replica.cc:333] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3: stopping tablet replica
I20260807 07:56:38.970345 27906 raft_consensus.cc:2243] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:38.970711 27906 raft_consensus.cc:2272] T 6d7e0974a32c4f3badc1a64cff604134 P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.972478 27906 tablet_replica.cc:333] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3: stopping tablet replica
I20260807 07:56:38.972932 27906 raft_consensus.cc:2243] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:38.973258 27906 raft_consensus.cc:2272] T 94516c5a3e66456688417841a07abf62 P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.974659 27906 tablet_replica.cc:333] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3: stopping tablet replica
I20260807 07:56:38.975088 27906 raft_consensus.cc:2243] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:38.975414 27906 raft_consensus.cc:2272] T 61189e76a3c848d693e6eed5cedc8b99 P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.976754 27906 tablet_replica.cc:333] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3: stopping tablet replica
I20260807 07:56:38.977173 27906 raft_consensus.cc:2243] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:38.977540 27906 raft_consensus.cc:2272] T 6ce70ac8492c4e3eaa7dbc4b245ff835 P 5f20fe56414c482e843f889d8ff335d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:38.979215 27906 tablet_replica.cc:333] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3: stopping tablet replica
I20260807 07:56:38.979624 27906 raft_consensus.cc:2243] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:38.979960 27906 raft_consensus.cc:2272] T f29619c1ec0c4f0ba1995d9389666fdc P 5f20fe56414c482e843f889d8ff335d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:39.002453 27906 tablet_server.cc:196] TabletServer@127.27.64.131:0 shutdown complete.
I20260807 07:56:39.013922 27906 master.cc:562] Master@127.27.64.190:34623 shutting down...
I20260807 07:56:39.028162 27906 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [term 1 LEADER]: Raft consensus shutting down.
I20260807 07:56:39.028674 27906 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:39.028977 27906 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9410dbdb906a42e7aa8a9b52ba0dd15c: stopping tablet replica
I20260807 07:56:39.046414 27906 master.cc:584] Master@127.27.64.190:34623 shutdown complete.
[ OK ] LeaderRebalancerTest.TestStepDownFailureDoesNotAbortPass (1913 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20260807 07:56:39.074571 27906 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.64.190:42791
I20260807 07:56:39.075677 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:56:39.080610 30190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:39.080681 30191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:39.082350 30193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:39.083106 27906 server_base.cc:1061] running on GCE node
I20260807 07:56:39.083823 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:56:39.083994 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:56:39.084124 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089399084113 us; error 0 us; skew 500 ppm
I20260807 07:56:39.084565 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:56:39.086676 27906 webserver.cc:533] Webserver started at http://127.27.64.190:43471/ using document root <none> and password file <none>
I20260807 07:56:39.087102 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:56:39.087258 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:56:39.087457 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:56:39.088476 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/master-0-root/instance:
uuid: "bea3ffe07a564dec8cb26697142f88e4"
format_stamp: "Formatted at 2026-08-07 07:56:39 on dist-test-slave-f0tn"
I20260807 07:56:39.092775 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260807 07:56:39.095975 30200 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:39.096650 27906 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 07:56:39.096892 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/master-0-root
uuid: "bea3ffe07a564dec8cb26697142f88e4"
format_stamp: "Formatted at 2026-08-07 07:56:39 on dist-test-slave-f0tn"
I20260807 07:56:39.097146 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:56:39.115518 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:56:39.116490 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:56:39.150959 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.190:42791
I20260807 07:56:39.151049 30272 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.190:42791 every 8 connection(s)
I20260807 07:56:39.154630 30274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.164242 30274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4: Bootstrap starting.
I20260807 07:56:39.168524 30274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:39.172362 30274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4: No bootstrap required, opened a new log
I20260807 07:56:39.174346 30274 raft_consensus.cc:359] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea3ffe07a564dec8cb26697142f88e4" member_type: VOTER }
I20260807 07:56:39.174726 30274 raft_consensus.cc:385] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:39.174957 30274 raft_consensus.cc:740] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea3ffe07a564dec8cb26697142f88e4, State: Initialized, Role: FOLLOWER
I20260807 07:56:39.175520 30274 consensus_queue.cc:260] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea3ffe07a564dec8cb26697142f88e4" member_type: VOTER }
I20260807 07:56:39.176005 30274 raft_consensus.cc:399] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 07:56:39.176239 30274 raft_consensus.cc:493] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 07:56:39.176492 30274 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:39.180574 30274 raft_consensus.cc:515] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea3ffe07a564dec8cb26697142f88e4" member_type: VOTER }
I20260807 07:56:39.181049 30274 leader_election.cc:304] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bea3ffe07a564dec8cb26697142f88e4; no voters:
I20260807 07:56:39.182217 30274 leader_election.cc:290] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 07:56:39.182541 30278 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:39.183792 30278 raft_consensus.cc:697] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [term 1 LEADER]: Becoming Leader. State: Replica: bea3ffe07a564dec8cb26697142f88e4, State: Running, Role: LEADER
I20260807 07:56:39.184458 30278 consensus_queue.cc:237] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea3ffe07a564dec8cb26697142f88e4" member_type: VOTER }
I20260807 07:56:39.184880 30274 sys_catalog.cc:565] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 07:56:39.187302 30279 sys_catalog.cc:455] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bea3ffe07a564dec8cb26697142f88e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea3ffe07a564dec8cb26697142f88e4" member_type: VOTER } }
I20260807 07:56:39.187397 30280 sys_catalog.cc:455] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bea3ffe07a564dec8cb26697142f88e4. Latest consensus state: current_term: 1 leader_uuid: "bea3ffe07a564dec8cb26697142f88e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea3ffe07a564dec8cb26697142f88e4" member_type: VOTER } }
I20260807 07:56:39.188045 30280 sys_catalog.cc:458] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [sys.catalog]: This master's current role is: LEADER
I20260807 07:56:39.188051 30279 sys_catalog.cc:458] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4 [sys.catalog]: This master's current role is: LEADER
I20260807 07:56:39.192239 30286 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260807 07:56:39.199062 30286 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260807 07:56:39.200011 27906 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260807 07:56:39.207195 30286 catalog_manager.cc:1383] Generated new cluster ID: 66153f72b9774b70ac0820b6d2bfa0a3
I20260807 07:56:39.207453 30286 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260807 07:56:39.225781 30286 catalog_manager.cc:1406] Generated new certificate authority record
I20260807 07:56:39.227035 30286 catalog_manager.cc:1540] Loading token signing keys...
I20260807 07:56:39.239239 30286 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4: Generated new TSK 0
I20260807 07:56:39.239800 30286 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260807 07:56:39.266553 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:56:39.271950 30305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:39.273027 30306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:39.275089 27906 server_base.cc:1061] running on GCE node
W20260807 07:56:39.275441 30310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:39.276306 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:56:39.276484 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:56:39.276612 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089399276592 us; error 0 us; skew 500 ppm
I20260807 07:56:39.277051 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:56:39.279114 27906 webserver.cc:533] Webserver started at http://127.27.64.129:43415/ using document root <none> and password file <none>
I20260807 07:56:39.279531 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:56:39.279690 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:56:39.279886 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:56:39.280877 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root/instance:
uuid: "b1188d7d3a0b455894bc443d571f6a19"
format_stamp: "Formatted at 2026-08-07 07:56:39 on dist-test-slave-f0tn"
I20260807 07:56:39.285071 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 07:56:39.288405 30316 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:39.289073 27906 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260807 07:56:39.289333 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root
uuid: "b1188d7d3a0b455894bc443d571f6a19"
format_stamp: "Formatted at 2026-08-07 07:56:39 on dist-test-slave-f0tn"
I20260807 07:56:39.289654 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:56:39.299269 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:56:39.300293 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:56:39.301662 27906 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 07:56:39.303762 27906 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:56:39.303943 27906 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:39.304153 27906 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 07:56:39.304298 27906 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:39.341164 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.129:36407
I20260807 07:56:39.341270 30405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.129:36407 every 8 connection(s)
I20260807 07:56:39.346112 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:56:39.352810 30413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:39.353899 30414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:39.355427 30418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:39.356259 27906 server_base.cc:1061] running on GCE node
I20260807 07:56:39.357273 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:56:39.357546 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:56:39.357712 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089399357699 us; error 0 us; skew 500 ppm
I20260807 07:56:39.358222 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:56:39.358500 30407 heartbeater.cc:344] Connected to a master server at 127.27.64.190:42791
I20260807 07:56:39.358853 30407 heartbeater.cc:461] Registering TS with master...
I20260807 07:56:39.359516 30407 heartbeater.cc:507] Master 127.27.64.190:42791 requested a full tablet report, sending...
I20260807 07:56:39.360745 27906 webserver.cc:533] Webserver started at http://127.27.64.130:40089/ using document root <none> and password file <none>
I20260807 07:56:39.361238 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:56:39.361459 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:56:39.361553 30223 ts_manager.cc:194] Registered new tserver with Master: b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:56:39.361716 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:56:39.362850 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root/instance:
uuid: "ef1ca7acf52a438f89f14707e9e06818"
format_stamp: "Formatted at 2026-08-07 07:56:39 on dist-test-slave-f0tn"
I20260807 07:56:39.363306 30223 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53640
I20260807 07:56:39.367274 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 07:56:39.370515 30426 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:39.371210 27906 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 07:56:39.371465 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root
uuid: "ef1ca7acf52a438f89f14707e9e06818"
format_stamp: "Formatted at 2026-08-07 07:56:39 on dist-test-slave-f0tn"
I20260807 07:56:39.371727 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:56:39.389775 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:56:39.390853 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:56:39.392333 27906 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 07:56:39.394522 27906 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:56:39.394721 27906 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:39.394942 27906 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 07:56:39.395094 27906 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:39.431924 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.130:35917
I20260807 07:56:39.432042 30521 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.130:35917 every 8 connection(s)
I20260807 07:56:39.436482 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:56:39.443439 30526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:39.445772 30527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:39.446391 27906 server_base.cc:1061] running on GCE node
W20260807 07:56:39.447119 30531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:39.448030 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:56:39.448292 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:56:39.448395 30523 heartbeater.cc:344] Connected to a master server at 127.27.64.190:42791
I20260807 07:56:39.448516 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089399448498 us; error 0 us; skew 500 ppm
I20260807 07:56:39.448854 30523 heartbeater.cc:461] Registering TS with master...
I20260807 07:56:39.449179 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:56:39.449618 30523 heartbeater.cc:507] Master 127.27.64.190:42791 requested a full tablet report, sending...
I20260807 07:56:39.451649 30223 ts_manager.cc:194] Registered new tserver with Master: ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:39.451867 27906 webserver.cc:533] Webserver started at http://127.27.64.131:40269/ using document root <none> and password file <none>
I20260807 07:56:39.452409 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:56:39.452596 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:56:39.452862 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:56:39.452929 30223 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53656
I20260807 07:56:39.454139 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root/instance:
uuid: "f831a53ec51d452398015797d543164e"
format_stamp: "Formatted at 2026-08-07 07:56:39 on dist-test-slave-f0tn"
I20260807 07:56:39.458320 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 07:56:39.461367 30537 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:39.462085 27906 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260807 07:56:39.462381 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root
uuid: "f831a53ec51d452398015797d543164e"
format_stamp: "Formatted at 2026-08-07 07:56:39 on dist-test-slave-f0tn"
I20260807 07:56:39.462651 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:56:39.474325 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:56:39.475373 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:56:39.476711 27906 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 07:56:39.478880 27906 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:56:39.479074 27906 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:39.479293 27906 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 07:56:39.479445 27906 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:39.516655 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.131:33207
I20260807 07:56:39.516782 30627 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.131:33207 every 8 connection(s)
I20260807 07:56:39.534215 30628 heartbeater.cc:344] Connected to a master server at 127.27.64.190:42791
I20260807 07:56:39.534632 30628 heartbeater.cc:461] Registering TS with master...
I20260807 07:56:39.535367 30628 heartbeater.cc:507] Master 127.27.64.190:42791 requested a full tablet report, sending...
I20260807 07:56:39.537287 30223 ts_manager.cc:194] Registered new tserver with Master: f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:39.538030 27906 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018260468s
I20260807 07:56:39.538898 30223 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53660
I20260807 07:56:39.562894 30223 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53662:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 07:56:39.568624 30223 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 07:56:39.766165 30357 tablet_service.cc:1511] Processing CreateTablet for tablet dde7991fc81a4de2920445f4d2abe599 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 07:56:39.767541 30357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde7991fc81a4de2920445f4d2abe599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.767198 30355 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5785da4aac4398afc22beefd2bd76b (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 07:56:39.768458 30355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5785da4aac4398afc22beefd2bd76b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.769490 30356 tablet_service.cc:1511] Processing CreateTablet for tablet af8f2d95eba240e2965db9be8b951bee (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 07:56:39.770133 30348 tablet_service.cc:1511] Processing CreateTablet for tablet f2c57e3fb98348029b5e341d17d669bd (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 07:56:39.770432 30353 tablet_service.cc:1511] Processing CreateTablet for tablet a6acbd1341f44b138a96457c583930e4 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 07:56:39.770810 30356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8f2d95eba240e2965db9be8b951bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.771657 30353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6acbd1341f44b138a96457c583930e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.772411 30350 tablet_service.cc:1511] Processing CreateTablet for tablet 488daa184a3f4a30a48872c9fc1612dd (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 07:56:39.773687 30350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488daa184a3f4a30a48872c9fc1612dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.778450 30351 tablet_service.cc:1511] Processing CreateTablet for tablet 0eeea67c5e49472292549e65f2c9e844 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 07:56:39.779695 30351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eeea67c5e49472292549e65f2c9e844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.781596 30348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c57e3fb98348029b5e341d17d669bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.785334 30576 tablet_service.cc:1511] Processing CreateTablet for tablet dde7991fc81a4de2920445f4d2abe599 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 07:56:39.786779 30570 tablet_service.cc:1511] Processing CreateTablet for tablet 0eeea67c5e49472292549e65f2c9e844 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 07:56:39.787501 30575 tablet_service.cc:1511] Processing CreateTablet for tablet af8f2d95eba240e2965db9be8b951bee (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 07:56:39.788460 30565 tablet_service.cc:1511] Processing CreateTablet for tablet f2c57e3fb98348029b5e341d17d669bd (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 07:56:39.788957 30569 tablet_service.cc:1511] Processing CreateTablet for tablet 488daa184a3f4a30a48872c9fc1612dd (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 07:56:39.789665 30573 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5785da4aac4398afc22beefd2bd76b (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 07:56:39.791777 30571 tablet_service.cc:1511] Processing CreateTablet for tablet a6acbd1341f44b138a96457c583930e4 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 07:56:39.794368 30576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde7991fc81a4de2920445f4d2abe599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.794972 30573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5785da4aac4398afc22beefd2bd76b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.797139 30571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6acbd1341f44b138a96457c583930e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.801795 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8f2d95eba240e2965db9be8b951bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.804605 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c57e3fb98348029b5e341d17d669bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.806421 30569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488daa184a3f4a30a48872c9fc1612dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.806125 30472 tablet_service.cc:1511] Processing CreateTablet for tablet dde7991fc81a4de2920445f4d2abe599 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260807 07:56:39.807025 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eeea67c5e49472292549e65f2c9e844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.806875 30462 tablet_service.cc:1511] Processing CreateTablet for tablet f2c57e3fb98348029b5e341d17d669bd (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260807 07:56:39.807439 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde7991fc81a4de2920445f4d2abe599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.808529 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 488daa184a3f4a30a48872c9fc1612dd (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260807 07:56:39.809839 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488daa184a3f4a30a48872c9fc1612dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.810379 30466 tablet_service.cc:1511] Processing CreateTablet for tablet a6acbd1341f44b138a96457c583930e4 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260807 07:56:39.811642 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6acbd1341f44b138a96457c583930e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.813241 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c57e3fb98348029b5e341d17d669bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.814400 30470 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5785da4aac4398afc22beefd2bd76b (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260807 07:56:39.815703 30470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5785da4aac4398afc22beefd2bd76b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.817927 30464 tablet_service.cc:1511] Processing CreateTablet for tablet 0eeea67c5e49472292549e65f2c9e844 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260807 07:56:39.819212 30464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eeea67c5e49472292549e65f2c9e844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.821956 30471 tablet_service.cc:1511] Processing CreateTablet for tablet af8f2d95eba240e2965db9be8b951bee (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260807 07:56:39.823465 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8f2d95eba240e2965db9be8b951bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.825107 30347 tablet_service.cc:1511] Processing CreateTablet for tablet 37222025709f4384a02a9c633ee3190c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 07:56:39.826453 30347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37222025709f4384a02a9c633ee3190c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.851157 30459 tablet_service.cc:1511] Processing CreateTablet for tablet 37222025709f4384a02a9c633ee3190c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 07:56:39.852545 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37222025709f4384a02a9c633ee3190c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.863435 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 37222025709f4384a02a9c633ee3190c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260807 07:56:39.864912 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37222025709f4384a02a9c633ee3190c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.878249 30353 tablet_service.cc:1511] Processing CreateTablet for tablet dfc043461f2840a385956057685df8f9 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 07:56:39.878266 30458 tablet_service.cc:1511] Processing CreateTablet for tablet dfc043461f2840a385956057685df8f9 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 07:56:39.880478 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc043461f2840a385956057685df8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.897758 30353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc043461f2840a385956057685df8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.910825 30653 tablet_bootstrap.cc:492] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:39.914605 30565 tablet_service.cc:1511] Processing CreateTablet for tablet dfc043461f2840a385956057685df8f9 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260807 07:56:39.916806 30653 tablet_bootstrap.cc:654] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:39.917534 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc043461f2840a385956057685df8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.926775 30654 tablet_bootstrap.cc:492] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:39.929056 30658 tablet_bootstrap.cc:492] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:39.931844 30462 tablet_service.cc:1511] Processing CreateTablet for tablet 7bb6a0a753b94f2c8b30e9ae87311e53 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 07:56:39.933058 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bb6a0a753b94f2c8b30e9ae87311e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.934989 30570 tablet_service.cc:1511] Processing CreateTablet for tablet 7bb6a0a753b94f2c8b30e9ae87311e53 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 07:56:39.935859 30351 tablet_service.cc:1511] Processing CreateTablet for tablet d30d61dc67614c5c9d0f1083e2a463b9 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 07:56:39.936303 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bb6a0a753b94f2c8b30e9ae87311e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.938301 30350 tablet_service.cc:1511] Processing CreateTablet for tablet 0a83ce36401344a4bb739af7bc87033e (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 07:56:39.939488 30350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a83ce36401344a4bb739af7bc87033e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.940455 30569 tablet_service.cc:1511] Processing CreateTablet for tablet d30d61dc67614c5c9d0f1083e2a463b9 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 07:56:39.941660 30569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d30d61dc67614c5c9d0f1083e2a463b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.942026 30573 tablet_service.cc:1511] Processing CreateTablet for tablet 0a83ce36401344a4bb739af7bc87033e (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 07:56:39.942767 30355 tablet_service.cc:1511] Processing CreateTablet for tablet 7bb6a0a753b94f2c8b30e9ae87311e53 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260807 07:56:39.943918 30355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bb6a0a753b94f2c8b30e9ae87311e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.945923 30470 tablet_service.cc:1511] Processing CreateTablet for tablet 0a83ce36401344a4bb739af7bc87033e (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260807 07:56:39.947121 30470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a83ce36401344a4bb739af7bc87033e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.948660 30654 tablet_bootstrap.cc:654] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:39.949934 30573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a83ce36401344a4bb739af7bc87033e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.951659 30658 tablet_bootstrap.cc:654] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:39.956629 30351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d30d61dc67614c5c9d0f1083e2a463b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.965672 30472 tablet_service.cc:1511] Processing CreateTablet for tablet d30d61dc67614c5c9d0f1083e2a463b9 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260807 07:56:39.966929 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d30d61dc67614c5c9d0f1083e2a463b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.976374 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 917731a02aaa4ad1bda800eb0961e3ce (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 07:56:39.977593 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 917731a02aaa4ad1bda800eb0961e3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.982379 30347 tablet_service.cc:1511] Processing CreateTablet for tablet 917731a02aaa4ad1bda800eb0961e3ce (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 07:56:39.982858 30654 tablet_bootstrap.cc:492] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:39.983422 30654 ts_tablet_manager.cc:1403] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.057s user 0.011s sys 0.000s
I20260807 07:56:39.985303 30570 tablet_service.cc:1511] Processing CreateTablet for tablet 917731a02aaa4ad1bda800eb0961e3ce (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260807 07:56:39.986632 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 917731a02aaa4ad1bda800eb0961e3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.986800 30654 raft_consensus.cc:359] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:39.987622 30654 raft_consensus.cc:385] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:39.988065 30654 raft_consensus.cc:740] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:39.992215 30653 tablet_bootstrap.cc:492] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:39.990132 30654 consensus_queue.cc:260] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:39.992826 30653 ts_tablet_manager.cc:1403] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.082s user 0.012s sys 0.008s
I20260807 07:56:39.992290 30658 tablet_bootstrap.cc:492] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:39.993446 30658 ts_tablet_manager.cc:1403] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.065s user 0.013s sys 0.014s
I20260807 07:56:39.995571 30653 raft_consensus.cc:359] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:39.996285 30653 raft_consensus.cc:385] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:39.996605 30653 raft_consensus.cc:740] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:39.996162 30658 raft_consensus.cc:359] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:39.997290 30658 raft_consensus.cc:385] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:39.997640 30658 raft_consensus.cc:740] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:39.997922 30628 heartbeater.cc:499] Master 127.27.64.190:42791 was elected leader, sending a full tablet report...
I20260807 07:56:39.998188 30347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 917731a02aaa4ad1bda800eb0961e3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.000072 30654 ts_tablet_manager.cc:1434] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.016s user 0.008s sys 0.000s
I20260807 07:56:40.001011 30654 tablet_bootstrap.cc:492] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:39.997416 30653 consensus_queue.cc:260] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.005565 30458 tablet_service.cc:1511] Processing CreateTablet for tablet bca8ce0c4383454c82aca8ba08488278 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 07:56:40.006750 30654 tablet_bootstrap.cc:654] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.006795 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca8ce0c4383454c82aca8ba08488278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:39.998493 30658 consensus_queue.cc:260] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.011579 30355 tablet_service.cc:1511] Processing CreateTablet for tablet bca8ce0c4383454c82aca8ba08488278 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 07:56:40.013033 30355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca8ce0c4383454c82aca8ba08488278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.019829 30654 tablet_bootstrap.cc:492] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:40.020345 30654 ts_tablet_manager.cc:1403] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.000s
I20260807 07:56:40.025931 30654 raft_consensus.cc:359] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.026675 30654 raft_consensus.cc:385] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.026979 30654 raft_consensus.cc:740] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.027858 30353 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3e02cee5d54a65bd61ae2521a9944c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 07:56:40.034296 30523 heartbeater.cc:499] Master 127.27.64.190:42791 was elected leader, sending a full tablet report...
I20260807 07:56:40.036662 30653 ts_tablet_manager.cc:1434] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.044s user 0.010s sys 0.001s
I20260807 07:56:40.037678 30407 heartbeater.cc:499] Master 127.27.64.190:42791 was elected leader, sending a full tablet report...
I20260807 07:56:40.037709 30653 tablet_bootstrap.cc:492] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:40.038688 30462 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3e02cee5d54a65bd61ae2521a9944c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 07:56:40.032850 30353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3e02cee5d54a65bd61ae2521a9944c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.042982 30658 ts_tablet_manager.cc:1434] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.049s user 0.016s sys 0.000s
I20260807 07:56:40.044051 30658 tablet_bootstrap.cc:492] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:40.052791 30565 tablet_service.cc:1511] Processing CreateTablet for tablet bca8ce0c4383454c82aca8ba08488278 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260807 07:56:40.049989 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3e02cee5d54a65bd61ae2521a9944c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.064589 30573 tablet_service.cc:1511] Processing CreateTablet for tablet 1c3e02cee5d54a65bd61ae2521a9944c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260807 07:56:40.065181 30355 tablet_service.cc:1511] Processing CreateTablet for tablet c8f2551f38a348389729e12d49142027 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 07:56:40.065874 30573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3e02cee5d54a65bd61ae2521a9944c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.066437 30355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f2551f38a348389729e12d49142027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.070189 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca8ce0c4383454c82aca8ba08488278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.071898 30658 tablet_bootstrap.cc:654] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.076630 30570 tablet_service.cc:1511] Processing CreateTablet for tablet c8f2551f38a348389729e12d49142027 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 07:56:40.031515 30654 consensus_queue.cc:260] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.078820 30472 tablet_service.cc:1511] Processing CreateTablet for tablet c8f2551f38a348389729e12d49142027 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260807 07:56:40.081496 30654 ts_tablet_manager.cc:1434] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.061s user 0.008s sys 0.000s
I20260807 07:56:40.081645 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f2551f38a348389729e12d49142027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.081692 30350 tablet_service.cc:1511] Processing CreateTablet for tablet 5df190e0d6d146e8a2f82d090c06ecdf (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 07:56:40.079094 30653 tablet_bootstrap.cc:654] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.078800 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 5df190e0d6d146e8a2f82d090c06ecdf (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 07:56:40.077841 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8f2551f38a348389729e12d49142027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.086488 30350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df190e0d6d146e8a2f82d090c06ecdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.086879 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df190e0d6d146e8a2f82d090c06ecdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.097771 30654 tablet_bootstrap.cc:492] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:40.103716 30569 tablet_service.cc:1511] Processing CreateTablet for tablet 5df190e0d6d146e8a2f82d090c06ecdf (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260807 07:56:40.104959 30569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df190e0d6d146e8a2f82d090c06ecdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.110718 30470 tablet_service.cc:1511] Processing CreateTablet for tablet 69fb90f4806e416fb031249c3df91aa8 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 07:56:40.111088 30653 tablet_bootstrap.cc:492] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:40.111740 30653 ts_tablet_manager.cc:1403] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.074s user 0.007s sys 0.004s
I20260807 07:56:40.111945 30470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fb90f4806e416fb031249c3df91aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.117080 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 75bed1078db6464388c6bf0bea4a4be6 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 07:56:40.117128 30575 tablet_service.cc:1511] Processing CreateTablet for tablet 69fb90f4806e416fb031249c3df91aa8 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 07:56:40.118438 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75bed1078db6464388c6bf0bea4a4be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.118527 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fb90f4806e416fb031249c3df91aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.127462 30654 tablet_bootstrap.cc:654] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.128696 30347 tablet_service.cc:1511] Processing CreateTablet for tablet 75bed1078db6464388c6bf0bea4a4be6 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 07:56:40.139979 30347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75bed1078db6464388c6bf0bea4a4be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.142437 30658 tablet_bootstrap.cc:492] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:40.142936 30658 ts_tablet_manager.cc:1403] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.099s user 0.010s sys 0.001s
I20260807 07:56:40.121253 30653 raft_consensus.cc:359] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.146047 30653 raft_consensus.cc:385] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.145731 30658 raft_consensus.cc:359] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.146354 30653 raft_consensus.cc:740] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.146420 30658 raft_consensus.cc:385] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.146799 30658 raft_consensus.cc:740] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.147280 30653 consensus_queue.cc:260] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.147614 30658 consensus_queue.cc:260] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.149643 30575 tablet_service.cc:1511] Processing CreateTablet for tablet 75bed1078db6464388c6bf0bea4a4be6 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260807 07:56:40.150903 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75bed1078db6464388c6bf0bea4a4be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.149654 30472 tablet_service.cc:1511] Processing CreateTablet for tablet 8918375a62fa49ce8a2a4e5ef0f403df (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 07:56:40.152279 30653 ts_tablet_manager.cc:1434] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.034s user 0.005s sys 0.000s
I20260807 07:56:40.134454 30353 tablet_service.cc:1511] Processing CreateTablet for tablet 69fb90f4806e416fb031249c3df91aa8 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260807 07:56:40.152964 30350 tablet_service.cc:1511] Processing CreateTablet for tablet 8918375a62fa49ce8a2a4e5ef0f403df (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 07:56:40.154145 30353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fb90f4806e416fb031249c3df91aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.156353 30350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8918375a62fa49ce8a2a4e5ef0f403df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.156555 30570 tablet_service.cc:1511] Processing CreateTablet for tablet 8918375a62fa49ce8a2a4e5ef0f403df (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260807 07:56:40.157723 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8918375a62fa49ce8a2a4e5ef0f403df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.161650 30355 tablet_service.cc:1511] Processing CreateTablet for tablet 02ec7850a44f4310aa712fd0c381c65c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 07:56:40.162909 30355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ec7850a44f4310aa712fd0c381c65c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.164460 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8918375a62fa49ce8a2a4e5ef0f403df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.167093 30658 ts_tablet_manager.cc:1434] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20260807 07:56:40.174108 30658 tablet_bootstrap.cc:492] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:40.175498 30573 tablet_service.cc:1511] Processing CreateTablet for tablet 02ec7850a44f4310aa712fd0c381c65c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 07:56:40.176759 30573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ec7850a44f4310aa712fd0c381c65c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.177704 30351 tablet_service.cc:1511] Processing CreateTablet for tablet e6f61d2b65b04216b54f6a2f8deadd0a (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 07:56:40.178930 30351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f61d2b65b04216b54f6a2f8deadd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.180189 30654 tablet_bootstrap.cc:492] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:40.180691 30654 ts_tablet_manager.cc:1403] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.083s user 0.009s sys 0.000s
I20260807 07:56:40.183456 30654 raft_consensus.cc:359] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.184145 30654 raft_consensus.cc:385] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.184444 30654 raft_consensus.cc:740] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.188732 30462 tablet_service.cc:1511] Processing CreateTablet for tablet e6f61d2b65b04216b54f6a2f8deadd0a (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 07:56:40.153208 30653 tablet_bootstrap.cc:492] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:40.190001 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f61d2b65b04216b54f6a2f8deadd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.190999 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 02ec7850a44f4310aa712fd0c381c65c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260807 07:56:40.194495 30668 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:40.196327 30668 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.198833 30668 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:40.200004 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ec7850a44f4310aa712fd0c381c65c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 07:56:40.195776 30294 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:56:40.201819 30654 consensus_queue.cc:260] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.215417 30654 ts_tablet_manager.cc:1434] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.034s user 0.007s sys 0.000s
I20260807 07:56:40.216363 30654 tablet_bootstrap.cc:492] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:40.216872 30573 tablet_service.cc:1511] Processing CreateTablet for tablet e6f61d2b65b04216b54f6a2f8deadd0a (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260807 07:56:40.218152 30573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f61d2b65b04216b54f6a2f8deadd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.202867 30658 tablet_bootstrap.cc:654] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.194998 30653 tablet_bootstrap.cc:654] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.228482 30664 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:40.228976 30664 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.233428 30664 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:40.235289 30353 tablet_service.cc:1511] Processing CreateTablet for tablet 8c079d52d21e409b82acfebf494a8700 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 07:56:40.236586 30472 tablet_service.cc:1511] Processing CreateTablet for tablet 8c079d52d21e409b82acfebf494a8700 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 07:56:40.237950 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c079d52d21e409b82acfebf494a8700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.240382 30654 tablet_bootstrap.cc:654] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.236605 30353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c079d52d21e409b82acfebf494a8700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.244839 30658 tablet_bootstrap.cc:492] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:40.245332 30658 ts_tablet_manager.cc:1403] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.071s user 0.006s sys 0.008s
I20260807 07:56:40.248091 30658 raft_consensus.cc:359] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.248780 30658 raft_consensus.cc:385] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.249070 30658 raft_consensus.cc:740] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.251420 30653 tablet_bootstrap.cc:492] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:40.251878 30653 ts_tablet_manager.cc:1403] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.099s user 0.013s sys 0.001s
I20260807 07:56:40.254585 30653 raft_consensus.cc:359] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.255265 30653 raft_consensus.cc:385] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.255548 30653 raft_consensus.cc:740] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.257297 30653 consensus_queue.cc:260] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.258365 30658 consensus_queue.cc:260] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.258585 30575 tablet_service.cc:1511] Processing CreateTablet for tablet 8c079d52d21e409b82acfebf494a8700 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260807 07:56:40.259846 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c079d52d21e409b82acfebf494a8700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.261236 30654 tablet_bootstrap.cc:492] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:40.261802 30654 ts_tablet_manager.cc:1403] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.010s
I20260807 07:56:40.264524 30654 raft_consensus.cc:359] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.265234 30654 raft_consensus.cc:385] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.265542 30654 raft_consensus.cc:740] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.270763 30570 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb72552d8da48b78c58110bb0c84f61 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 07:56:40.271102 30350 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb72552d8da48b78c58110bb0c84f61 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 07:56:40.272046 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb72552d8da48b78c58110bb0c84f61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.272264 30350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb72552d8da48b78c58110bb0c84f61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.272717 30658 ts_tablet_manager.cc:1434] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.027s user 0.004s sys 0.001s
I20260807 07:56:40.274184 30658 tablet_bootstrap.cc:492] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:40.275710 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 5cb72552d8da48b78c58110bb0c84f61 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260807 07:56:40.277004 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb72552d8da48b78c58110bb0c84f61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.276579 30654 consensus_queue.cc:260] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.281344 30664 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:40.281840 30664 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.280680 30658 tablet_bootstrap.cc:654] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.283751 30664 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:40.271029 30653 ts_tablet_manager.cc:1434] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20260807 07:56:40.290285 30653 tablet_bootstrap.cc:492] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:40.314328 30462 tablet_service.cc:1511] Processing CreateTablet for tablet d590969fc25f460ba23a897afd565f56 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 07:56:40.315625 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d590969fc25f460ba23a897afd565f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.319103 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:40.320466 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:40.321153 30489 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:40.321420 30653 tablet_bootstrap.cc:654] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
W20260807 07:56:40.323750 30539 leader_election.cc:343] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.324566 30539 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:40.325484 30664 raft_consensus.cc:2804] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:40.325851 30664 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:40.326150 30664 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:40.326413 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:40.327806 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:40.328491 30372 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:40.328171 30351 tablet_service.cc:1511] Processing CreateTablet for tablet 26a3620947f6449ab35a25835dd90fda (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 07:56:40.334491 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:40.335100 30351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26a3620947f6449ab35a25835dd90fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.335172 30372 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:40.336871 30429 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:40.337718 30668 raft_consensus.cc:2804] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:40.338097 30668 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:40.334474 30575 tablet_service.cc:1511] Processing CreateTablet for tablet d590969fc25f460ba23a897afd565f56 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 07:56:40.338455 30668 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:40.339326 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d590969fc25f460ba23a897afd565f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.340950 30472 tablet_service.cc:1511] Processing CreateTablet for tablet 26a3620947f6449ab35a25835dd90fda (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 07:56:40.344673 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26a3620947f6449ab35a25835dd90fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.345875 30684 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:40.341758 30664 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.343322 30353 tablet_service.cc:1511] Processing CreateTablet for tablet d590969fc25f460ba23a897afd565f56 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260807 07:56:40.353637 30470 tablet_service.cc:1511] Processing CreateTablet for tablet 15fa23df425445ce99709045bc6e9789 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 07:56:40.353606 30684 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.354270 30353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d590969fc25f460ba23a897afd565f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.354992 30470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15fa23df425445ce99709045bc6e9789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.347389 30654 ts_tablet_manager.cc:1434] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.085s user 0.010s sys 0.023s
I20260807 07:56:40.355787 30684 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:56:40.337914 30541 leader_election.cc:343] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.356634 30541 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:40.356070 30654 tablet_bootstrap.cc:492] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:40.358654 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:40.359216 30489 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:40.350195 30570 tablet_service.cc:1511] Processing CreateTablet for tablet 26a3620947f6449ab35a25835dd90fda (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260807 07:56:40.352123 30350 tablet_service.cc:1511] Processing CreateTablet for tablet 15fa23df425445ce99709045bc6e9789 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 07:56:40.354904 30664 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:40.359120 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:40.345691 30668 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.363895 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:40.351037 30658 tablet_bootstrap.cc:492] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:40.362449 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:40.362916 30684 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 07:56:40.369227 30429 leader_election.cc:343] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.368968 30573 tablet_service.cc:1511] Processing CreateTablet for tablet 15fa23df425445ce99709045bc6e9789 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260807 07:56:40.371146 30355 tablet_service.cc:1511] Processing CreateTablet for tablet 1d130f3994424c29b619c9f702310fc9 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 07:56:40.366564 30372 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:40.373435 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 1d130f3994424c29b619c9f702310fc9 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 07:56:40.374639 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d130f3994424c29b619c9f702310fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.371562 30565 tablet_service.cc:1511] Processing CreateTablet for tablet 1d130f3994424c29b619c9f702310fc9 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260807 07:56:40.364957 30668 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:40.378171 30668 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:40.378579 30668 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.380429 30668 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:56:40.371610 30539 leader_election.cc:343] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.382874 30347 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9372d30eda4764a440dbb9f0bc8129 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 07:56:40.384948 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9372d30eda4764a440dbb9f0bc8129 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 07:56:40.386216 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9372d30eda4764a440dbb9f0bc8129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.386597 30658 ts_tablet_manager.cc:1403] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.113s user 0.009s sys 0.024s
I20260807 07:56:40.396617 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:56:40.398236 30541 leader_election.cc:343] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.398684 30541 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:40.398825 30372 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:40.398905 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:56:40.400497 30429 leader_election.cc:343] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.400658 30684 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:40.400518 30541 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:40.401859 30684 raft_consensus.cc:2804] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:40.402736 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:40.402855 30684 raft_consensus.cc:697] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:40.403463 30369 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:40.403985 30684 consensus_queue.cc:237] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.400933 30355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d130f3994424c29b619c9f702310fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.407292 30347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9372d30eda4764a440dbb9f0bc8129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.409035 30569 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9372d30eda4764a440dbb9f0bc8129 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260807 07:56:40.410910 30369 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:40.412050 30429 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:40.412889 30668 raft_consensus.cc:2804] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:40.413326 30668 raft_consensus.cc:697] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:40.414180 30668 consensus_queue.cc:237] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.415642 30357 tablet_service.cc:1511] Processing CreateTablet for tablet 61ca595a07a748bb83b4aa11cb066270 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 07:56:40.416879 30357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ca595a07a748bb83b4aa11cb066270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.422643 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26a3620947f6449ab35a25835dd90fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.423249 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 61ca595a07a748bb83b4aa11cb066270 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 07:56:40.426446 30654 tablet_bootstrap.cc:654] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.427085 30348 tablet_service.cc:1511] Processing CreateTablet for tablet f6c4147ecb7e4996ac3b4ff12effa194 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 07:56:40.428283 30348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c4147ecb7e4996ac3b4ff12effa194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.429641 30576 tablet_service.cc:1511] Processing CreateTablet for tablet f6c4147ecb7e4996ac3b4ff12effa194 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 07:56:40.432091 30356 tablet_service.cc:1511] Processing CreateTablet for tablet 42f1efe3594f411d9ed19ae2875c1bf0 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 07:56:40.433280 30356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f1efe3594f411d9ed19ae2875c1bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.433852 30464 tablet_service.cc:1511] Processing CreateTablet for tablet 42f1efe3594f411d9ed19ae2875c1bf0 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 07:56:40.435065 30464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f1efe3594f411d9ed19ae2875c1bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.435191 30350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15fa23df425445ce99709045bc6e9789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.437237 30664 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:40.437726 30664 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.438548 30667 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:40.439036 30667 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.443320 30667 leader_election.cc:290] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:40.449421 30571 tablet_service.cc:1511] Processing CreateTablet for tablet 42f1efe3594f411d9ed19ae2875c1bf0 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260807 07:56:40.438506 30463 tablet_service.cc:1511] Processing CreateTablet for tablet f6c4147ecb7e4996ac3b4ff12effa194 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260807 07:56:40.450084 30466 tablet_service.cc:1511] Processing CreateTablet for tablet 1906743dbae54f6b90d1d039e2394d50 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 07:56:40.451042 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c4147ecb7e4996ac3b4ff12effa194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.454342 30563 tablet_service.cc:1511] Processing CreateTablet for tablet 1906743dbae54f6b90d1d039e2394d50 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 07:56:40.459452 30459 tablet_service.cc:1511] Processing CreateTablet for tablet aa37679a25174c858a325e86cb2d5c94 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 07:56:40.460669 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa37679a25174c858a325e86cb2d5c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.463189 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:40.463668 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d130f3994424c29b619c9f702310fc9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 07:56:40.464507 30429 leader_election.cc:343] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.466493 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:40.468302 30471 tablet_service.cc:1511] Processing CreateTablet for tablet 457aab41fd17414ab083fedaf23f3ff8 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 07:56:40.469532 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457aab41fd17414ab083fedaf23f3ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.473237 30653 tablet_bootstrap.cc:492] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:40.473665 30653 ts_tablet_manager.cc:1403] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.184s user 0.014s sys 0.003s
I20260807 07:56:40.475816 30653 raft_consensus.cc:359] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:56:40.476289 30653 raft_consensus.cc:385] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.476469 30653 raft_consensus.cc:740] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.443369 30489 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:40.477195 30653 consensus_queue.cc:260] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:56:40.464833 30664 leader_election.cc:290] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:40.477830 30573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15fa23df425445ce99709045bc6e9789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.478091 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:40.477152 30562 tablet_service.cc:1511] Processing CreateTablet for tablet aa37679a25174c858a325e86cb2d5c94 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260807 07:56:40.482115 30539 leader_election.cc:343] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.482677 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1906743dbae54f6b90d1d039e2394d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.497771 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ca595a07a748bb83b4aa11cb066270. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 07:56:40.500614 30429 leader_election.cc:343] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.501078 30429 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:40.501323 30562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa37679a25174c858a325e86cb2d5c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.507661 30658 raft_consensus.cc:359] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.508375 30658 raft_consensus.cc:385] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.508646 30658 raft_consensus.cc:740] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.510205 30668 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:40.524104 30571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f1efe3594f411d9ed19ae2875c1bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.521061 30658 consensus_queue.cc:260] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.516672 30472 tablet_service.cc:1511] Processing CreateTablet for tablet 61ca595a07a748bb83b4aa11cb066270 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260807 07:56:40.531942 30576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c4147ecb7e4996ac3b4ff12effa194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.544148 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:40.548796 30563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1906743dbae54f6b90d1d039e2394d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.537217 30222 catalog_manager.cc:5697] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:40.551632 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ca595a07a748bb83b4aa11cb066270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.553754 30569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9372d30eda4764a440dbb9f0bc8129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.530812 30575 tablet_service.cc:1511] Processing CreateTablet for tablet 457aab41fd17414ab083fedaf23f3ff8 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 07:56:40.555230 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457aab41fd17414ab083fedaf23f3ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.526648 30221 catalog_manager.cc:5697] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:40.567188 30667 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:40.567660 30667 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:56:40.569562 30667 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:40.570953 30658 ts_tablet_manager.cc:1434] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.184s user 0.007s sys 0.000s
I20260807 07:56:40.572047 30658 tablet_bootstrap.cc:492] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
W20260807 07:56:40.574275 30317 leader_election.cc:343] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.575897 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:40.583011 30658 tablet_bootstrap.cc:654] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.594857 30653 ts_tablet_manager.cc:1434] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.121s user 0.006s sys 0.000s
W20260807 07:56:40.596865 30317 leader_election.cc:343] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.598048 30653 tablet_bootstrap.cc:492] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:40.598189 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:40.598857 30369 raft_consensus.cc:2468] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:40.600463 30357 tablet_service.cc:1511] Processing CreateTablet for tablet 1906743dbae54f6b90d1d039e2394d50 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260807 07:56:40.601713 30357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1906743dbae54f6b90d1d039e2394d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.603619 30654 tablet_bootstrap.cc:492] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:40.604091 30654 ts_tablet_manager.cc:1403] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.248s user 0.014s sys 0.007s
I20260807 07:56:40.606734 30350 tablet_service.cc:1511] Processing CreateTablet for tablet aa37679a25174c858a325e86cb2d5c94 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260807 07:56:40.606848 30654 raft_consensus.cc:359] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:56:40.607079 30348 tablet_service.cc:1511] Processing CreateTablet for tablet 457aab41fd17414ab083fedaf23f3ff8 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260807 07:56:40.607571 30654 raft_consensus.cc:385] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.607959 30350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa37679a25174c858a325e86cb2d5c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.609023 30348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457aab41fd17414ab083fedaf23f3ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.610962 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 24224c3e18ec49578bb6c7bd4fd217b5 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 07:56:40.612152 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24224c3e18ec49578bb6c7bd4fd217b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.612864 30356 tablet_service.cc:1511] Processing CreateTablet for tablet 24224c3e18ec49578bb6c7bd4fd217b5 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 07:56:40.619957 30356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24224c3e18ec49578bb6c7bd4fd217b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.620427 30570 tablet_service.cc:1511] Processing CreateTablet for tablet 24224c3e18ec49578bb6c7bd4fd217b5 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260807 07:56:40.621659 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24224c3e18ec49578bb6c7bd4fd217b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.625089 30653 tablet_bootstrap.cc:654] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.637132 30541 leader_election.cc:304] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:40.638325 30684 raft_consensus.cc:2804] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:40.638687 30684 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:40.638988 30684 raft_consensus.cc:3060] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:40.640821 30471 tablet_service.cc:1511] Processing CreateTablet for tablet 30057a01f5fa4baba4b3b02fe84a0f78 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 07:56:40.643476 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30057a01f5fa4baba4b3b02fe84a0f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.644817 30565 tablet_service.cc:1511] Processing CreateTablet for tablet 30057a01f5fa4baba4b3b02fe84a0f78 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 07:56:40.645540 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:40.646680 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30057a01f5fa4baba4b3b02fe84a0f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.649739 30668 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:40.650277 30668 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.652338 30668 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:40.654377 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:40.655279 30684 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.656400 30588 raft_consensus.cc:2393] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 1: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
W20260807 07:56:40.656418 30429 leader_election.cc:343] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.658277 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:40.658938 30590 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:40.607913 30654 raft_consensus.cc:740] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.666141 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:56:40.667529 30539 leader_election.cc:343] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.667742 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:40.668282 30369 raft_consensus.cc:3060] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:40.668762 30429 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:56:40.669878 30668 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:40.670249 30668 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:40.670603 30668 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:40.670465 30355 tablet_service.cc:1511] Processing CreateTablet for tablet 30057a01f5fa4baba4b3b02fe84a0f78 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260807 07:56:40.671461 30355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30057a01f5fa4baba4b3b02fe84a0f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.674577 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:40.675570 30653 tablet_bootstrap.cc:492] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:40.676076 30653 ts_tablet_manager.cc:1403] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.078s user 0.010s sys 0.004s
I20260807 07:56:40.677884 30320 leader_election.cc:304] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:40.678823 30653 raft_consensus.cc:359] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.679531 30653 raft_consensus.cc:385] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.679821 30653 raft_consensus.cc:740] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.680606 30653 consensus_queue.cc:260] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.679535 30369 raft_consensus.cc:2468] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:40.686281 30667 raft_consensus.cc:2749] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:40.687178 30668 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.690698 30668 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:40.664444 30684 leader_election.cc:290] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:40.675614 30654 consensus_queue.cc:260] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:56:40.690960 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:40.695987 30590 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
W20260807 07:56:40.697295 30429 leader_election.cc:343] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.698123 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:40.698302 30466 tablet_service.cc:1511] Processing CreateTablet for tablet fe6785f099494896ae258fd098deadc1 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 07:56:40.698693 30588 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:40.699533 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6785f099494896ae258fd098deadc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.702472 30570 tablet_service.cc:1511] Processing CreateTablet for tablet fe6785f099494896ae258fd098deadc1 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 07:56:40.703646 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6785f099494896ae258fd098deadc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.704300 30471 tablet_service.cc:1511] Processing CreateTablet for tablet f16f3d2817a34261bb25577fa0f9e2de (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 07:56:40.705480 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16f3d2817a34261bb25577fa0f9e2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.697288 30654 ts_tablet_manager.cc:1434] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.093s user 0.006s sys 0.001s
I20260807 07:56:40.707732 30654 tablet_bootstrap.cc:492] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:40.704159 30653 ts_tablet_manager.cc:1434] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.028s user 0.010s sys 0.005s
I20260807 07:56:40.708861 30653 tablet_bootstrap.cc:492] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:40.704245 30658 tablet_bootstrap.cc:492] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:40.710278 30658 ts_tablet_manager.cc:1403] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.138s user 0.006s sys 0.016s
I20260807 07:56:40.714470 30653 tablet_bootstrap.cc:654] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.718451 30466 tablet_service.cc:1511] Processing CreateTablet for tablet 39d207f188764d0caf032e77702cdc6b (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 07:56:40.723521 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39d207f188764d0caf032e77702cdc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.720399 30588 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:40.726212 30429 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:56:40.726326 30541 leader_election.cc:304] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:40.713037 30658 raft_consensus.cc:359] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.726665 30350 tablet_service.cc:1511] Processing CreateTablet for tablet fe6785f099494896ae258fd098deadc1 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260807 07:56:40.727011 30668 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:40.722064 30571 tablet_service.cc:1511] Processing CreateTablet for tablet f16f3d2817a34261bb25577fa0f9e2de (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 07:56:40.727519 30668 raft_consensus.cc:697] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:40.727900 30350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6785f099494896ae258fd098deadc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.729147 30571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16f3d2817a34261bb25577fa0f9e2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.729141 30668 consensus_queue.cc:237] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.727144 30658 raft_consensus.cc:385] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.732016 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 6e83da4401b5430295d02124cfe24f58 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 07:56:40.733446 30658 raft_consensus.cc:740] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.734181 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e83da4401b5430295d02124cfe24f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.734230 30658 consensus_queue.cc:260] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.736811 30658 ts_tablet_manager.cc:1434] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.026s user 0.006s sys 0.000s
I20260807 07:56:40.737777 30658 tablet_bootstrap.cc:492] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:40.738574 30570 tablet_service.cc:1511] Processing CreateTablet for tablet 6e83da4401b5430295d02124cfe24f58 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 07:56:40.739692 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e83da4401b5430295d02124cfe24f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.727458 30684 raft_consensus.cc:2804] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:40.732822 30654 tablet_bootstrap.cc:654] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.750895 30684 raft_consensus.cc:697] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:40.752382 30684 consensus_queue.cc:237] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.755980 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 2496d339b41b4d3688937a21d02d09f4 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 07:56:40.757251 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2496d339b41b4d3688937a21d02d09f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.767746 30570 tablet_service.cc:1511] Processing CreateTablet for tablet 2496d339b41b4d3688937a21d02d09f4 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 07:56:40.768996 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2496d339b41b4d3688937a21d02d09f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.770107 30565 tablet_service.cc:1511] Processing CreateTablet for tablet 39d207f188764d0caf032e77702cdc6b (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 07:56:40.771327 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39d207f188764d0caf032e77702cdc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.777171 30658 tablet_bootstrap.cc:654] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:40.760414 30320 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:40.792989 30704 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:40.793422 30704 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:40.793756 30704 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:40.793681 30573 tablet_service.cc:1511] Processing CreateTablet for tablet fec40d34629d434cae5f2c35d4e6dfa8 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 07:56:40.798012 30573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec40d34629d434cae5f2c35d4e6dfa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.798228 30575 tablet_service.cc:1511] Processing CreateTablet for tablet 726dbe2fbaee4ca8aa75b18959ed1ef5 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 07:56:40.799417 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 726dbe2fbaee4ca8aa75b18959ed1ef5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 07:56:40.801697 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 56325us
I20260807 07:56:40.804044 30357 tablet_service.cc:1511] Processing CreateTablet for tablet 39d207f188764d0caf032e77702cdc6b (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260807 07:56:40.807737 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 726dbe2fbaee4ca8aa75b18959ed1ef5 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 07:56:40.808897 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 726dbe2fbaee4ca8aa75b18959ed1ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.810470 30356 tablet_service.cc:1511] Processing CreateTablet for tablet 6e83da4401b5430295d02124cfe24f58 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260807 07:56:40.811338 30348 tablet_service.cc:1511] Processing CreateTablet for tablet 2496d339b41b4d3688937a21d02d09f4 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260807 07:56:40.805356 30357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39d207f188764d0caf032e77702cdc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.816110 30472 tablet_service.cc:1511] Processing CreateTablet for tablet 5b78e546552f4ce38217f522549d6f36 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 07:56:40.817297 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b78e546552f4ce38217f522549d6f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.817420 30347 tablet_service.cc:1511] Processing CreateTablet for tablet 5b78e546552f4ce38217f522549d6f36 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 07:56:40.818707 30347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b78e546552f4ce38217f522549d6f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.822248 30222 catalog_manager.cc:5697] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:40.815075 30355 tablet_service.cc:1511] Processing CreateTablet for tablet f16f3d2817a34261bb25577fa0f9e2de (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260807 07:56:40.790392 30471 tablet_service.cc:1511] Processing CreateTablet for tablet fec40d34629d434cae5f2c35d4e6dfa8 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 07:56:40.825730 30356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e83da4401b5430295d02124cfe24f58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.809475 30704 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:56:40.815217 30353 tablet_service.cc:1511] Processing CreateTablet for tablet fec40d34629d434cae5f2c35d4e6dfa8 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260807 07:56:40.832945 30459 tablet_service.cc:1511] Processing CreateTablet for tablet 78ad63a77c6546d6bc5db4234526fc78 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 07:56:40.835819 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ad63a77c6546d6bc5db4234526fc78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.835907 30704 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:40.836648 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec40d34629d434cae5f2c35d4e6dfa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.831399 30221 catalog_manager.cc:5697] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:40.839514 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:56:40.840924 30317 leader_election.cc:343] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:40.833247 30348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2496d339b41b4d3688937a21d02d09f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.845336 30570 tablet_service.cc:1511] Processing CreateTablet for tablet 5b78e546552f4ce38217f522549d6f36 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260807 07:56:40.845443 30355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16f3d2817a34261bb25577fa0f9e2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.853063 30351 tablet_service.cc:1511] Processing CreateTablet for tablet 78ad63a77c6546d6bc5db4234526fc78 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 07:56:40.853987 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:40.859553 30588 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:40.857705 30350 tablet_service.cc:1511] Processing CreateTablet for tablet 726dbe2fbaee4ca8aa75b18959ed1ef5 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260807 07:56:40.858484 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b78e546552f4ce38217f522549d6f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.876519 30346 tablet_service.cc:1511] Processing CreateTablet for tablet d0f6bb896213415485f2dee06ba250b8 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 07:56:40.878749 30653 tablet_bootstrap.cc:492] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:40.879242 30653 ts_tablet_manager.cc:1403] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.171s user 0.010s sys 0.014s
I20260807 07:56:40.884202 30471 tablet_service.cc:1511] Processing CreateTablet for tablet d0f6bb896213415485f2dee06ba250b8 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 07:56:40.885457 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f6bb896213415485f2dee06ba250b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.884647 30570 tablet_service.cc:1511] Processing CreateTablet for tablet d0f6bb896213415485f2dee06ba250b8 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260807 07:56:40.889072 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f6bb896213415485f2dee06ba250b8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 07:56:40.891278 30429 consensus_peers.cc:597] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 -> Peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Couldn't send request to peer f831a53ec51d452398015797d543164e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:40.873548 30353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec40d34629d434cae5f2c35d4e6dfa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.895773 30346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f6bb896213415485f2dee06ba250b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.895900 30345 tablet_service.cc:1511] Processing CreateTablet for tablet a35e1cb09e2146a084cf577b068e4140 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 07:56:40.897141 30345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35e1cb09e2146a084cf577b068e4140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.898339 30463 tablet_service.cc:1511] Processing CreateTablet for tablet a35e1cb09e2146a084cf577b068e4140 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 07:56:40.899428 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35e1cb09e2146a084cf577b068e4140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.900046 30588 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:40.901208 30320 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:40.902246 30351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ad63a77c6546d6bc5db4234526fc78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.902405 30704 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:40.902853 30704 raft_consensus.cc:697] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:40.903468 30575 tablet_service.cc:1511] Processing CreateTablet for tablet 78ad63a77c6546d6bc5db4234526fc78 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260807 07:56:40.903714 30704 consensus_queue.cc:237] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:56:40.904722 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78ad63a77c6546d6bc5db4234526fc78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.910879 30658 tablet_bootstrap.cc:492] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:40.911388 30658 ts_tablet_manager.cc:1403] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.174s user 0.009s sys 0.007s
I20260807 07:56:40.917910 30654 tablet_bootstrap.cc:492] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:40.918403 30654 ts_tablet_manager.cc:1403] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.211s user 0.016s sys 0.028s
I20260807 07:56:40.918660 30658 raft_consensus.cc:359] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:56:40.919366 30658 raft_consensus.cc:385] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.919654 30658 raft_consensus.cc:740] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.929714 30350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 726dbe2fbaee4ca8aa75b18959ed1ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.930058 30653 raft_consensus.cc:359] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.930765 30653 raft_consensus.cc:385] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.931046 30653 raft_consensus.cc:740] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.931772 30653 consensus_queue.cc:260] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.935443 30658 consensus_queue.cc:260] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:56:40.921097 30654 raft_consensus.cc:359] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.940064 30654 raft_consensus.cc:385] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:40.940379 30654 raft_consensus.cc:740] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:40.952433 30684 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:40.941100 30654 consensus_queue.cc:260] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.958384 30658 ts_tablet_manager.cc:1434] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.047s user 0.000s sys 0.008s
I20260807 07:56:40.958918 30654 ts_tablet_manager.cc:1434] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.040s user 0.007s sys 0.000s
I20260807 07:56:40.959398 30658 tablet_bootstrap.cc:492] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:40.962953 30654 tablet_bootstrap.cc:492] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:40.965225 30664 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:40.969987 30653 ts_tablet_manager.cc:1434] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.090s user 0.005s sys 0.002s
I20260807 07:56:40.970949 30653 tablet_bootstrap.cc:492] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:40.992229 30668 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:40.992739 30668 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:40.991737 30575 tablet_service.cc:1511] Processing CreateTablet for tablet a35e1cb09e2146a084cf577b068e4140 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260807 07:56:40.995994 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35e1cb09e2146a084cf577b068e4140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.994727 30668 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:40.999974 30355 tablet_service.cc:1511] Processing CreateTablet for tablet 0032603adf8446cd9a59f26cc868400c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 07:56:41.001132 30355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0032603adf8446cd9a59f26cc868400c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:40.998687 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:41.002048 30367 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:41.003840 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:41.004252 30429 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:41.004454 30588 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:41.005074 30668 raft_consensus.cc:2804] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:41.006479 30668 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:41.006829 30668 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.008456 30472 tablet_service.cc:1511] Processing CreateTablet for tablet 0032603adf8446cd9a59f26cc868400c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 07:56:41.009560 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0032603adf8446cd9a59f26cc868400c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.014969 30565 tablet_service.cc:1511] Processing CreateTablet for tablet 0032603adf8446cd9a59f26cc868400c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260807 07:56:41.016211 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0032603adf8446cd9a59f26cc868400c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.017609 30463 tablet_service.cc:1511] Processing CreateTablet for tablet ed9fcd0597fe4e24a7e11fe5c535623c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 07:56:41.018678 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9fcd0597fe4e24a7e11fe5c535623c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.024348 30222 catalog_manager.cc:5697] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:41.027498 30653 tablet_bootstrap.cc:654] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.027314 30689 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:41.029560 30668 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.034359 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:41.034909 30372 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.036782 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:41.037343 30588 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.041615 30654 tablet_bootstrap.cc:654] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.041278 30372 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:41.051337 30658 tablet_bootstrap.cc:654] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.050383 30668 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:41.067566 30429 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:41.068427 30689 raft_consensus.cc:2804] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:41.072536 30654 tablet_bootstrap.cc:492] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:41.075400 30355 tablet_service.cc:1511] Processing CreateTablet for tablet 32d8c79eca1d4172b7e3662b5e509782 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 07:56:41.076283 30355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32d8c79eca1d4172b7e3662b5e509782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.076968 30351 tablet_service.cc:1511] Processing CreateTablet for tablet 8f836ea19b1942d09da90d65732435dc (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 07:56:41.078207 30351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f836ea19b1942d09da90d65732435dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.081511 30654 ts_tablet_manager.cc:1403] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.119s user 0.010s sys 0.008s
I20260807 07:56:41.068807 30588 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:41.082238 30570 tablet_service.cc:1511] Processing CreateTablet for tablet 8f836ea19b1942d09da90d65732435dc (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 07:56:41.082849 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 8f836ea19b1942d09da90d65732435dc (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260807 07:56:41.083403 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f836ea19b1942d09da90d65732435dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.084124 30348 tablet_service.cc:1511] Processing CreateTablet for tablet ed9fcd0597fe4e24a7e11fe5c535623c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 07:56:41.084419 30654 raft_consensus.cc:359] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.085121 30654 raft_consensus.cc:385] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.085364 30348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9fcd0597fe4e24a7e11fe5c535623c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.085700 30704 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:41.086196 30704 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.087611 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f836ea19b1942d09da90d65732435dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.082264 30573 tablet_service.cc:1511] Processing CreateTablet for tablet ed9fcd0597fe4e24a7e11fe5c535623c (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260807 07:56:41.092860 30654 raft_consensus.cc:740] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.123158 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7ae50210ec4ccbb091fa0962200c3e (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 07:56:41.123407 30472 tablet_service.cc:1511] Processing CreateTablet for tablet 32d8c79eca1d4172b7e3662b5e509782 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 07:56:41.124279 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7ae50210ec4ccbb091fa0962200c3e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 07:56:41.114413 30716 log.cc:927] Time spent T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.065s user 0.001s sys 0.000s
I20260807 07:56:41.127624 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32d8c79eca1d4172b7e3662b5e509782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.113792 30689 raft_consensus.cc:697] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:41.135440 30689 consensus_queue.cc:237] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.139700 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:41.141770 30353 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7ae50210ec4ccbb091fa0962200c3e (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 07:56:41.142064 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:41.142795 30588 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:41.143167 30353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7ae50210ec4ccbb091fa0962200c3e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 07:56:41.145314 30317 leader_election.cc:343] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:41.147574 30654 consensus_queue.cc:260] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.149051 30320 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:41.149421 30565 tablet_service.cc:1511] Processing CreateTablet for tablet 0e7ae50210ec4ccbb091fa0962200c3e (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260807 07:56:41.149921 30654 ts_tablet_manager.cc:1434] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.068s user 0.007s sys 0.000s
I20260807 07:56:41.150905 30654 tablet_bootstrap.cc:492] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:41.150740 30355 tablet_service.cc:1511] Processing CreateTablet for tablet 14880a591ef44360b5046f67cab3d4ad (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 07:56:41.138043 30573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed9fcd0597fe4e24a7e11fe5c535623c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.151947 30355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14880a591ef44360b5046f67cab3d4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.154206 30667 raft_consensus.cc:2804] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:41.154561 30667 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:41.154881 30667 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.153190 30704 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:41.159296 30653 tablet_bootstrap.cc:492] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:41.159788 30653 ts_tablet_manager.cc:1403] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.189s user 0.009s sys 0.011s
I20260807 07:56:41.162189 30471 tablet_service.cc:1511] Processing CreateTablet for tablet 151ecad19f9e4079986c980524b2f3c0 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 07:56:41.163529 30471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151ecad19f9e4079986c980524b2f3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.166330 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 9136a853c15441a6a0460d9da5efd3e9 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 07:56:41.167621 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9136a853c15441a6a0460d9da5efd3e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.170476 30575 tablet_service.cc:1511] Processing CreateTablet for tablet 14880a591ef44360b5046f67cab3d4ad (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 07:56:41.172309 30571 tablet_service.cc:1511] Processing CreateTablet for tablet 151ecad19f9e4079986c980524b2f3c0 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 07:56:41.175112 30472 tablet_service.cc:1511] Processing CreateTablet for tablet 3c1d04e8312f4ddcb5bcfc4160d4e615 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 07:56:41.176259 30472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c1d04e8312f4ddcb5bcfc4160d4e615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.177199 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 14880a591ef44360b5046f67cab3d4ad (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260807 07:56:41.178704 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14880a591ef44360b5046f67cab3d4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.173441 30466 tablet_service.cc:1511] Processing CreateTablet for tablet dbbfdde9e309488aa336d6982fa31c49 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 07:56:41.180423 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbfdde9e309488aa336d6982fa31c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.180714 30658 tablet_bootstrap.cc:492] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:41.181201 30658 ts_tablet_manager.cc:1403] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.222s user 0.018s sys 0.006s
I20260807 07:56:41.180932 30569 tablet_service.cc:1511] Processing CreateTablet for tablet 9136a853c15441a6a0460d9da5efd3e9 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 07:56:41.153421 30565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e7ae50210ec4ccbb091fa0962200c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.186902 30564 tablet_service.cc:1511] Processing CreateTablet for tablet 3c1d04e8312f4ddcb5bcfc4160d4e615 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 07:56:41.188961 30459 tablet_service.cc:1511] Processing CreateTablet for tablet 4bfc4a881ee74873ae444b3fd4dbcd78 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 07:56:41.190183 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bfc4a881ee74873ae444b3fd4dbcd78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.194458 30653 raft_consensus.cc:359] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.194680 30658 raft_consensus.cc:359] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.195385 30653 raft_consensus.cc:385] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.195431 30658 raft_consensus.cc:385] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.195860 30653 raft_consensus.cc:740] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.195955 30658 raft_consensus.cc:740] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.186947 30569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9136a853c15441a6a0460d9da5efd3e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.197098 30658 consensus_queue.cc:260] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.197832 30564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c1d04e8312f4ddcb5bcfc4160d4e615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.198921 30664 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:41.199394 30664 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.200176 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14880a591ef44360b5046f67cab3d4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.201596 30571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151ecad19f9e4079986c980524b2f3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.207206 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:41.207846 30489 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:41.209124 30539 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:41.210007 30684 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:41.210386 30684 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:41.210714 30684 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.211726 30667 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.213778 30667 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:41.218190 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:56:41.220191 30294 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:56:41.221599 30653 consensus_queue.cc:260] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.224692 30684 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.225404 30664 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:41.226017 30658 ts_tablet_manager.cc:1434] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.043s user 0.007s sys 0.001s
W20260807 07:56:41.239684 30317 leader_election.cc:343] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:41.247064 30658 tablet_bootstrap.cc:492] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:41.241988 30570 tablet_service.cc:1511] Processing CreateTablet for tablet 32d8c79eca1d4172b7e3662b5e509782 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260807 07:56:41.243067 30653 ts_tablet_manager.cc:1434] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.083s user 0.006s sys 0.001s
I20260807 07:56:41.255271 30653 tablet_bootstrap.cc:492] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:41.256053 30684 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:41.243775 30723 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:41.257985 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:41.258904 30489 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.259264 30658 tablet_bootstrap.cc:654] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.262032 30570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32d8c79eca1d4172b7e3662b5e509782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.257730 30723 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:56:41.266184 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:41.266866 30588 raft_consensus.cc:2393] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:56:41.271293 30653 tablet_bootstrap.cc:654] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.286397 30575 tablet_service.cc:1511] Processing CreateTablet for tablet dbbfdde9e309488aa336d6982fa31c49 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 07:56:41.287282 30723 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:56:41.287747 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbfdde9e309488aa336d6982fa31c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.290696 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:41.294692 30490 raft_consensus.cc:3060] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.297861 30654 tablet_bootstrap.cc:654] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.305544 30429 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:41.307255 30573 tablet_service.cc:1511] Processing CreateTablet for tablet 4bfc4a881ee74873ae444b3fd4dbcd78 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 07:56:41.308485 30573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bfc4a881ee74873ae444b3fd4dbcd78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.307188 30723 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.356240 30653 tablet_bootstrap.cc:492] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:41.356660 30653 ts_tablet_manager.cc:1403] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.102s user 0.003s sys 0.010s
I20260807 07:56:41.361796 30684 consensus_queue.cc:1048] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:41.361642 30367 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.361829 30689 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 07:56:41.375976 30653 raft_consensus.cc:359] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.382220 30653 raft_consensus.cc:385] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.382594 30653 raft_consensus.cc:740] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.385596 30221 catalog_manager.cc:5697] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:41.392325 30658 tablet_bootstrap.cc:492] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:41.392851 30658 ts_tablet_manager.cc:1403] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.146s user 0.023s sys 0.030s
I20260807 07:56:41.392647 30489 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:41.396626 30658 raft_consensus.cc:359] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.397291 30658 raft_consensus.cc:385] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.397574 30658 raft_consensus.cc:740] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.398434 30658 consensus_queue.cc:260] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.401039 30658 ts_tablet_manager.cc:1434] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260807 07:56:41.405827 30658 tablet_bootstrap.cc:492] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:41.384066 30653 consensus_queue.cc:260] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.411499 30653 ts_tablet_manager.cc:1434] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.055s user 0.001s sys 0.008s
I20260807 07:56:41.412540 30653 tablet_bootstrap.cc:492] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:41.404840 30723 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:41.416592 30539 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:41.418176 30684 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:41.419028 30684 raft_consensus.cc:697] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:41.421115 30723 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:41.425567 30658 tablet_bootstrap.cc:654] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
W20260807 07:56:41.426028 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 277055us
I20260807 07:56:41.428860 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:41.429484 30588 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.432577 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:41.433633 30369 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:41.436203 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:41.437098 30369 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.420593 30684 consensus_queue.cc:237] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.456779 30654 tablet_bootstrap.cc:492] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:41.457204 30654 ts_tablet_manager.cc:1403] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.307s user 0.021s sys 0.004s
I20260807 07:56:41.462857 30355 tablet_service.cc:1511] Processing CreateTablet for tablet 151ecad19f9e4079986c980524b2f3c0 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260807 07:56:41.464097 30355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151ecad19f9e4079986c980524b2f3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.475217 30588 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:41.474982 30351 tablet_service.cc:1511] Processing CreateTablet for tablet 9136a853c15441a6a0460d9da5efd3e9 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260807 07:56:41.478926 30351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9136a853c15441a6a0460d9da5efd3e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.482894 30653 tablet_bootstrap.cc:654] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.487429 30369 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:41.487244 30348 tablet_service.cc:1511] Processing CreateTablet for tablet dbbfdde9e309488aa336d6982fa31c49 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260807 07:56:41.490240 30353 tablet_service.cc:1511] Processing CreateTablet for tablet 4bfc4a881ee74873ae444b3fd4dbcd78 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260807 07:56:41.491829 30730 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:41.492010 30345 tablet_service.cc:1511] Processing CreateTablet for tablet 3c1d04e8312f4ddcb5bcfc4160d4e615 (DEFAULT_TABLE table=test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260807 07:56:41.489240 30348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbfdde9e309488aa336d6982fa31c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.493726 30320 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:41.494616 30730 raft_consensus.cc:2804] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:41.494952 30353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bfc4a881ee74873ae444b3fd4dbcd78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.495103 30730 raft_consensus.cc:697] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:41.496371 30345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c1d04e8312f4ddcb5bcfc4160d4e615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:41.495961 30730 consensus_queue.cc:237] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.502595 30654 raft_consensus.cc:359] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.502969 30664 consensus_queue.cc:1048] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:41.505369 30222 catalog_manager.cc:5697] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:41.503270 30654 raft_consensus.cc:385] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.506893 30654 raft_consensus.cc:740] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.507670 30654 consensus_queue.cc:260] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.509799 30654 ts_tablet_manager.cc:1434] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.052s user 0.004s sys 0.003s
I20260807 07:56:41.510708 30654 tablet_bootstrap.cc:492] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:41.532747 30667 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:41.585233 30654 tablet_bootstrap.cc:654] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.610381 30653 tablet_bootstrap.cc:492] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:41.610980 30653 ts_tablet_manager.cc:1403] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.199s user 0.020s sys 0.028s
I20260807 07:56:41.634791 30653 raft_consensus.cc:359] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.635504 30653 raft_consensus.cc:385] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.635766 30653 raft_consensus.cc:740] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.643997 30653 consensus_queue.cc:260] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.645944 30653 ts_tablet_manager.cc:1434] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.035s user 0.010s sys 0.000s
I20260807 07:56:41.646651 30653 tablet_bootstrap.cc:492] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:41.657353 30653 tablet_bootstrap.cc:654] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.662817 30743 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:41.663367 30743 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.668248 30658 tablet_bootstrap.cc:492] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:41.670867 30658 ts_tablet_manager.cc:1403] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.265s user 0.008s sys 0.014s
I20260807 07:56:41.674620 30658 raft_consensus.cc:359] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.675298 30658 raft_consensus.cc:385] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.675595 30658 raft_consensus.cc:740] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.676396 30658 consensus_queue.cc:260] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.678682 30658 ts_tablet_manager.cc:1434] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.008s user 0.003s sys 0.002s
I20260807 07:56:41.680522 30658 tablet_bootstrap.cc:492] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:41.684852 30743 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:41.688231 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:41.690277 30369 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:41.693120 30658 tablet_bootstrap.cc:654] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.696652 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:56:41.698469 30429 leader_election.cc:343] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:41.704967 30429 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:41.706916 30743 raft_consensus.cc:2804] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:41.707541 30743 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:41.708194 30743 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.702139 30222 catalog_manager.cc:5697] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:41.721951 30743 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.727046 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:41.727943 30369 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.728382 30743 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:41.728790 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:41.731383 30654 tablet_bootstrap.cc:492] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
W20260807 07:56:41.731165 30429 leader_election.cc:343] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:41.731877 30654 ts_tablet_manager.cc:1403] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.221s user 0.018s sys 0.014s
I20260807 07:56:41.735734 30654 raft_consensus.cc:359] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.736378 30654 raft_consensus.cc:385] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.736631 30654 raft_consensus.cc:740] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.737562 30654 consensus_queue.cc:260] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.740643 30654 ts_tablet_manager.cc:1434] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260807 07:56:41.741683 30654 tablet_bootstrap.cc:492] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:41.751053 30653 tablet_bootstrap.cc:492] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:41.751645 30653 ts_tablet_manager.cc:1403] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.105s user 0.012s sys 0.000s
I20260807 07:56:41.754928 30369 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:41.756189 30653 raft_consensus.cc:359] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.760394 30653 raft_consensus.cc:385] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.760697 30653 raft_consensus.cc:740] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.761348 30653 consensus_queue.cc:260] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.764045 30653 ts_tablet_manager.cc:1434] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.012s user 0.001s sys 0.007s
I20260807 07:56:41.764787 30658 tablet_bootstrap.cc:492] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:41.764951 30653 tablet_bootstrap.cc:492] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:41.771880 30653 tablet_bootstrap.cc:654] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.759760 30654 tablet_bootstrap.cc:654] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.765292 30658 ts_tablet_manager.cc:1403] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.085s user 0.017s sys 0.013s
I20260807 07:56:41.774402 30429 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:41.776255 30743 raft_consensus.cc:2804] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:41.777060 30743 raft_consensus.cc:697] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:41.778616 30743 consensus_queue.cc:237] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.779913 30658 raft_consensus.cc:359] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.780596 30658 raft_consensus.cc:385] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.780869 30658 raft_consensus.cc:740] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.784652 30658 consensus_queue.cc:260] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.792100 30757 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:41.791824 30689 consensus_queue.cc:1048] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:41.793149 30654 tablet_bootstrap.cc:492] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:41.792855 30757 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.793722 30654 ts_tablet_manager.cc:1403] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.052s user 0.013s sys 0.004s
I20260807 07:56:41.796312 30658 ts_tablet_manager.cc:1434] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.021s user 0.008s sys 0.000s
I20260807 07:56:41.801329 30658 tablet_bootstrap.cc:492] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:41.805478 30757 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:41.806846 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:41.807986 30689 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:41.809868 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:41.808818 30689 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.818140 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:41.818357 30539 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:41.820266 30654 raft_consensus.cc:359] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.820927 30654 raft_consensus.cc:385] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.821165 30654 raft_consensus.cc:740] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.821723 30689 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:41.821805 30668 consensus_queue.cc:1048] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:41.821179 30757 raft_consensus.cc:2749] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:41.821851 30654 consensus_queue.cc:260] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.826596 30654 ts_tablet_manager.cc:1434] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.030s user 0.006s sys 0.001s
I20260807 07:56:41.828872 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:41.830286 30590 raft_consensus.cc:2393] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:56:41.832458 30654 tablet_bootstrap.cc:492] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:41.841804 30429 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:41.843853 30668 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.847630 30654 tablet_bootstrap.cc:654] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.854808 30658 tablet_bootstrap.cc:654] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.858381 30223 catalog_manager.cc:5697] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:41.863407 30653 tablet_bootstrap.cc:492] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:41.863935 30653 ts_tablet_manager.cc:1403] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.099s user 0.023s sys 0.009s
I20260807 07:56:41.869809 30653 raft_consensus.cc:359] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.870465 30653 raft_consensus.cc:385] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.870783 30653 raft_consensus.cc:740] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.872557 30653 consensus_queue.cc:260] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.872915 30668 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:41.874704 30653 ts_tablet_manager.cc:1434] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260807 07:56:41.875648 30653 tablet_bootstrap.cc:492] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:41.905220 30658 tablet_bootstrap.cc:492] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:41.905689 30658 ts_tablet_manager.cc:1403] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.107s user 0.011s sys 0.009s
I20260807 07:56:41.909312 30757 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:41.910117 30658 raft_consensus.cc:359] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.910889 30658 raft_consensus.cc:385] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.911158 30658 raft_consensus.cc:740] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:41.910106 30757 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.912168 30658 consensus_queue.cc:260] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.914911 30757 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:41.917726 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:41.918721 30490 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:41.920953 30539 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:41.922757 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:41.923696 30369 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:41.926478 30757 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:41.927080 30757 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:41.927795 30757 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.929164 30658 ts_tablet_manager.cc:1434] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.023s user 0.008s sys 0.001s
I20260807 07:56:41.930125 30658 tablet_bootstrap.cc:492] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:41.939314 30664 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:41.951112 30653 tablet_bootstrap.cc:654] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.953619 30654 tablet_bootstrap.cc:492] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:41.953074 30667 consensus_queue.cc:1048] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:41.954257 30654 ts_tablet_manager.cc:1403] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.122s user 0.012s sys 0.013s
I20260807 07:56:41.953831 30658 tablet_bootstrap.cc:654] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:41.967135 30757 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.978014 30588 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:41.984927 30664 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:41.985317 30654 raft_consensus.cc:359] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:41.990643 30654 raft_consensus.cc:385] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:41.991101 30654 raft_consensus.cc:740] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.021983 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:42.023552 30369 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.036298 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:42.037271 30488 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.041522 30757 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:42.069749 30654 consensus_queue.cc:260] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.083626 30369 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:42.095640 30488 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:42.125440 30654 ts_tablet_manager.cc:1434] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.171s user 0.015s sys 0.017s
I20260807 07:56:42.126900 30654 tablet_bootstrap.cc:492] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:42.127635 30539 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:42.129467 30664 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:42.129940 30664 raft_consensus.cc:697] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:42.130769 30664 consensus_queue.cc:237] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.132584 30653 tablet_bootstrap.cc:492] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:42.133101 30653 ts_tablet_manager.cc:1403] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.258s user 0.017s sys 0.019s
I20260807 07:56:42.151489 30653 raft_consensus.cc:359] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.152264 30653 raft_consensus.cc:385] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.152531 30653 raft_consensus.cc:740] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.153264 30653 consensus_queue.cc:260] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.157750 30653 ts_tablet_manager.cc:1434] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20260807 07:56:42.158685 30653 tablet_bootstrap.cc:492] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:42.149829 30730 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:42.161484 30730 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.170898 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:42.171507 30667 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:56:42.172657 30317 leader_election.cc:343] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:42.172299 30667 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.180047 30667 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.181804 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:42.188515 30654 tablet_bootstrap.cc:654] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
W20260807 07:56:42.190239 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 63593.7us
W20260807 07:56:42.191082 30317 leader_election.cc:343] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:42.195674 30730 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.202543 30658 tablet_bootstrap.cc:492] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:42.203495 30658 ts_tablet_manager.cc:1403] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.274s user 0.018s sys 0.057s
I20260807 07:56:42.232103 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:42.234794 30223 catalog_manager.cc:5697] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:42.277959 30730 consensus_queue.cc:1048] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:42.286509 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:42.287389 30588 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:42.289479 30658 raft_consensus.cc:359] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.290149 30658 raft_consensus.cc:385] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.290405 30658 raft_consensus.cc:740] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.291051 30658 consensus_queue.cc:260] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.294004 30658 ts_tablet_manager.cc:1434] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.090s user 0.015s sys 0.013s
I20260807 07:56:42.296947 30658 tablet_bootstrap.cc:492] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
W20260807 07:56:42.301728 30320 leader_election.cc:343] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:42.302471 30320 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:42.305918 30730 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:42.312127 30588 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.313786 30658 tablet_bootstrap.cc:654] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.309175 30653 tablet_bootstrap.cc:654] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.336700 30743 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:42.357831 30320 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:42.360638 30730 raft_consensus.cc:2804] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 07:56:42.366582 30294 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:56:42.370990 30654 tablet_bootstrap.cc:492] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:42.371523 30654 ts_tablet_manager.cc:1403] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.245s user 0.030s sys 0.044s
I20260807 07:56:42.362738 30730 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:42.372893 30730 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.378742 30654 raft_consensus.cc:359] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.379287 30654 raft_consensus.cc:385] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.379518 30654 raft_consensus.cc:740] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.380206 30664 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:42.380906 30664 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.381791 30743 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:42.385087 30664 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:42.386996 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:42.390110 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:42.392875 30541 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:42.397065 30654 consensus_queue.cc:260] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.401562 30654 ts_tablet_manager.cc:1434] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.030s user 0.006s sys 0.003s
I20260807 07:56:42.402534 30654 tablet_bootstrap.cc:492] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:42.402942 30653 tablet_bootstrap.cc:492] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:42.403261 30658 tablet_bootstrap.cc:492] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:42.403424 30653 ts_tablet_manager.cc:1403] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.245s user 0.008s sys 0.018s
I20260807 07:56:42.403730 30658 ts_tablet_manager.cc:1403] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.107s user 0.020s sys 0.009s
I20260807 07:56:42.408325 30730 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.411118 30723 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:42.411825 30723 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.412765 30658 raft_consensus.cc:359] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.413426 30658 raft_consensus.cc:385] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.413699 30658 raft_consensus.cc:740] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.416597 30723 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.417891 30658 consensus_queue.cc:260] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.418648 30730 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.420276 30658 ts_tablet_manager.cc:1434] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.016s user 0.007s sys 0.004s
I20260807 07:56:42.421237 30658 tablet_bootstrap.cc:492] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:42.465160 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:42.468250 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:56:42.468559 30317 leader_election.cc:343] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:42.488808 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:42.492784 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:42.493752 30590 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
W20260807 07:56:42.495193 30429 leader_election.cc:343] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:42.502768 30664 raft_consensus.cc:2749] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:56:42.514024 30654 tablet_bootstrap.cc:654] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.521931 30590 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:42.507838 30653 raft_consensus.cc:359] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.523458 30653 raft_consensus.cc:385] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.523881 30653 raft_consensus.cc:740] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.524600 30320 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:42.524960 30653 consensus_queue.cc:260] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.527794 30372 raft_consensus.cc:2468] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:42.528304 30667 raft_consensus.cc:2804] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:42.528874 30667 raft_consensus.cc:697] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:42.530472 30658 tablet_bootstrap.cc:654] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.530117 30667 consensus_queue.cc:237] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.530673 30653 ts_tablet_manager.cc:1434] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.127s user 0.010s sys 0.003s
I20260807 07:56:42.534228 30429 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:42.535356 30743 raft_consensus.cc:2804] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:42.535699 30743 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:42.536064 30743 raft_consensus.cc:3060] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.542018 30653 tablet_bootstrap.cc:492] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:42.552505 30658 tablet_bootstrap.cc:492] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:42.553354 30658 ts_tablet_manager.cc:1403] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.132s user 0.010s sys 0.011s
I20260807 07:56:42.552646 30654 tablet_bootstrap.cc:492] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:42.555755 30654 ts_tablet_manager.cc:1403] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.153s user 0.013s sys 0.005s
I20260807 07:56:42.559442 30743 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.561637 30653 tablet_bootstrap.cc:654] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.562316 30658 raft_consensus.cc:359] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.562834 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:42.562613 30654 raft_consensus.cc:359] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.563486 30654 raft_consensus.cc:385] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.563503 30372 raft_consensus.cc:3060] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.563869 30654 raft_consensus.cc:740] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.563084 30658 raft_consensus.cc:385] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.565225 30658 raft_consensus.cc:740] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.566044 30658 consensus_queue.cc:260] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.566499 30223 catalog_manager.cc:5697] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:42.568190 30654 consensus_queue.cc:260] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.574164 30654 ts_tablet_manager.cc:1434] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.018s user 0.003s sys 0.005s
I20260807 07:56:42.575560 30654 tablet_bootstrap.cc:492] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:42.567781 30658 ts_tablet_manager.cc:1434] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260807 07:56:42.582619 30372 raft_consensus.cc:2468] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:42.583751 30658 tablet_bootstrap.cc:492] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:42.586925 30743 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.588976 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:56:42.591020 30429 leader_election.cc:343] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:42.594157 30429 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:42.597280 30743 raft_consensus.cc:2804] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:42.597805 30743 raft_consensus.cc:697] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:42.598546 30743 consensus_queue.cc:237] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.599200 30654 tablet_bootstrap.cc:654] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.603137 30653 tablet_bootstrap.cc:492] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:42.603665 30653 ts_tablet_manager.cc:1403] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.062s user 0.007s sys 0.027s
I20260807 07:56:42.608915 30658 tablet_bootstrap.cc:654] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.608927 30743 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:42.609426 30223 catalog_manager.cc:5697] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:42.609838 30743 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.612990 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:42.614319 30654 tablet_bootstrap.cc:492] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:42.614765 30654 ts_tablet_manager.cc:1403] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.040s user 0.013s sys 0.003s
I20260807 07:56:42.608222 30653 raft_consensus.cc:359] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.616555 30653 raft_consensus.cc:385] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.616591 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:42.616170 30743 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.617002 30653 raft_consensus.cc:740] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.617409 30590 raft_consensus.cc:2393] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:56:42.618245 30653 consensus_queue.cc:260] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.618716 30429 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:42.620011 30743 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.623323 30653 ts_tablet_manager.cc:1434] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.019s user 0.008s sys 0.000s
I20260807 07:56:42.625619 30653 tablet_bootstrap.cc:492] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:42.627127 30654 raft_consensus.cc:359] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.627763 30654 raft_consensus.cc:385] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.628016 30654 raft_consensus.cc:740] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.628856 30654 consensus_queue.cc:260] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.633091 30743 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:42.635187 30654 ts_tablet_manager.cc:1434] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20260807 07:56:42.636123 30654 tablet_bootstrap.cc:492] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:42.637178 30658 tablet_bootstrap.cc:492] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:42.637629 30658 ts_tablet_manager.cc:1403] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.054s user 0.022s sys 0.011s
I20260807 07:56:42.638393 30653 tablet_bootstrap.cc:654] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.640296 30658 raft_consensus.cc:359] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.641659 30654 tablet_bootstrap.cc:654] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.640928 30658 raft_consensus.cc:385] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.642087 30658 raft_consensus.cc:740] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.643122 30658 consensus_queue.cc:260] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.644428 30653 tablet_bootstrap.cc:492] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:42.644948 30653 ts_tablet_manager.cc:1403] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.008s
I20260807 07:56:42.647073 30654 tablet_bootstrap.cc:492] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:42.654129 30658 ts_tablet_manager.cc:1434] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.016s user 0.009s sys 0.003s
I20260807 07:56:42.648208 30743 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:42.655238 30658 tablet_bootstrap.cc:492] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:42.654858 30743 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.656873 30743 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.647490 30653 raft_consensus.cc:359] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.657356 30653 raft_consensus.cc:385] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.657629 30653 raft_consensus.cc:740] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.658124 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:42.658553 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:42.654107 30654 ts_tablet_manager.cc:1403] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.001s
I20260807 07:56:42.659246 30590 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:42.660885 30658 tablet_bootstrap.cc:654] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.661489 30429 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:42.661996 30654 raft_consensus.cc:359] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.662318 30743 raft_consensus.cc:2804] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:42.663427 30689 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:42.663612 30743 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:42.664120 30743 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.663914 30689 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.666041 30689 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.662861 30653 consensus_queue.cc:260] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.666730 30372 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:42.668283 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:42.669852 30653 ts_tablet_manager.cc:1434] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.025s user 0.006s sys 0.006s
I20260807 07:56:42.663404 30654 raft_consensus.cc:385] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.670400 30654 raft_consensus.cc:740] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
W20260807 07:56:42.671036 30429 leader_election.cc:343] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:42.671792 30653 tablet_bootstrap.cc:492] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:42.673199 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:56:42.674719 30429 leader_election.cc:343] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:42.675465 30654 consensus_queue.cc:260] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.675204 30429 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:42.679306 30689 raft_consensus.cc:2749] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:42.679476 30743 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.682276 30654 ts_tablet_manager.cc:1434] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20260807 07:56:42.684055 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:42.684243 30743 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.685297 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:42.685920 30590 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.687042 30653 tablet_bootstrap.cc:654] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.687996 30654 tablet_bootstrap.cc:492] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:42.692761 30590 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:42.693697 30654 tablet_bootstrap.cc:654] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.694092 30367 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.696035 30429 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:42.696444 30653 tablet_bootstrap.cc:492] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:42.696877 30653 ts_tablet_manager.cc:1403] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.025s user 0.012s sys 0.002s
I20260807 07:56:42.698004 30743 raft_consensus.cc:2804] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:42.698498 30743 raft_consensus.cc:697] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:42.699357 30743 consensus_queue.cc:237] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.699590 30653 raft_consensus.cc:359] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.700249 30653 raft_consensus.cc:385] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.700515 30653 raft_consensus.cc:740] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.701109 30653 consensus_queue.cc:260] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.703259 30653 ts_tablet_manager.cc:1434] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260807 07:56:42.704352 30653 tablet_bootstrap.cc:492] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:42.705147 30367 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:42.708738 30658 tablet_bootstrap.cc:492] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:42.709185 30658 ts_tablet_manager.cc:1403] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.054s user 0.016s sys 0.012s
I20260807 07:56:42.711241 30653 tablet_bootstrap.cc:654] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.713415 30658 raft_consensus.cc:359] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.714083 30658 raft_consensus.cc:385] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.714370 30658 raft_consensus.cc:740] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.714993 30658 consensus_queue.cc:260] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.716926 30658 ts_tablet_manager.cc:1434] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260807 07:56:42.717957 30658 tablet_bootstrap.cc:492] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:42.713438 30757 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:42.734184 30221 catalog_manager.cc:5697] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:42.735435 30658 tablet_bootstrap.cc:654] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.738062 30653 tablet_bootstrap.cc:492] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:42.739462 30653 ts_tablet_manager.cc:1403] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.035s user 0.016s sys 0.009s
I20260807 07:56:42.742631 30653 raft_consensus.cc:359] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.743291 30653 raft_consensus.cc:385] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.743541 30653 raft_consensus.cc:740] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.744304 30653 consensus_queue.cc:260] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.746129 30653 ts_tablet_manager.cc:1434] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 07:56:42.739634 30664 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260807 07:56:42.752314 30654 tablet_bootstrap.cc:492] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:42.752753 30654 ts_tablet_manager.cc:1403] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.065s user 0.021s sys 0.006s
I20260807 07:56:42.758698 30757 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:42.760810 30757 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.763113 30757 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:42.766542 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:42.767262 30372 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:42.761281 30653 tablet_bootstrap.cc:492] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:42.774910 30541 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:42.775777 30757 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:42.776152 30757 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:42.776485 30757 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.792534 30654 raft_consensus.cc:359] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.793269 30654 raft_consensus.cc:385] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.793571 30654 raft_consensus.cc:740] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.794193 30654 consensus_queue.cc:260] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.796128 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:42.796841 30490 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:42.797328 30658 tablet_bootstrap.cc:492] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:42.797820 30658 ts_tablet_manager.cc:1403] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.080s user 0.011s sys 0.010s
I20260807 07:56:42.799253 30654 ts_tablet_manager.cc:1434] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.046s user 0.014s sys 0.023s
I20260807 07:56:42.800467 30653 tablet_bootstrap.cc:654] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.800504 30658 raft_consensus.cc:359] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.801260 30658 raft_consensus.cc:385] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.802054 30654 tablet_bootstrap.cc:492] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:42.802006 30658 raft_consensus.cc:740] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.803483 30658 consensus_queue.cc:260] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.805670 30658 ts_tablet_manager.cc:1434] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.008s user 0.005s sys 0.002s
I20260807 07:56:42.807250 30658 tablet_bootstrap.cc:492] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:42.810276 30757 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.810696 30654 tablet_bootstrap.cc:654] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.813061 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:42.813634 30372 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.815323 30653 tablet_bootstrap.cc:492] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:42.815833 30653 ts_tablet_manager.cc:1403] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.055s user 0.020s sys 0.016s
I20260807 07:56:42.818627 30653 raft_consensus.cc:359] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.819285 30653 raft_consensus.cc:385] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.819547 30653 raft_consensus.cc:740] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.820338 30653 consensus_queue.cc:260] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.821573 30658 tablet_bootstrap.cc:654] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.822225 30654 tablet_bootstrap.cc:492] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:42.822654 30654 ts_tablet_manager.cc:1403] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.021s user 0.014s sys 0.003s
I20260807 07:56:42.822710 30653 ts_tablet_manager.cc:1434] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260807 07:56:42.823803 30653 tablet_bootstrap.cc:492] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:42.823952 30372 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:42.825273 30541 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:42.826315 30825 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:42.826794 30825 raft_consensus.cc:697] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:42.827690 30825 consensus_queue.cc:237] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.831962 30653 tablet_bootstrap.cc:654] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.825246 30654 raft_consensus.cc:359] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.835357 30654 raft_consensus.cc:385] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.835632 30654 raft_consensus.cc:740] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.836277 30654 consensus_queue.cc:260] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.837564 30788 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:42.838061 30788 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.840325 30788 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.840938 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:42.842682 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:42.843264 30590 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:42.844609 30320 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:42.845616 30654 ts_tablet_manager.cc:1434] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.023s user 0.007s sys 0.000s
I20260807 07:56:42.845952 30788 raft_consensus.cc:2804] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:42.846310 30788 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:42.846642 30788 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.846840 30654 tablet_bootstrap.cc:492] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:42.848754 30221 catalog_manager.cc:5697] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
W20260807 07:56:42.845664 30317 leader_election.cc:343] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:42.853699 30654 tablet_bootstrap.cc:654] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.854880 30757 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:42.855665 30689 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:42.856184 30689 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.853371 30788 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.858227 30689 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.858665 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:42.859228 30490 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.860627 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:42.861279 30590 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:42.862287 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:42.862583 30429 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:42.863204 30658 tablet_bootstrap.cc:492] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:42.863428 30689 raft_consensus.cc:2804] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:42.863657 30658 ts_tablet_manager.cc:1403] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.017s
I20260807 07:56:42.863780 30689 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:42.864292 30689 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.866686 30658 raft_consensus.cc:359] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.867322 30658 raft_consensus.cc:385] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.867589 30658 raft_consensus.cc:740] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.868335 30658 consensus_queue.cc:260] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.868942 30490 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
W20260807 07:56:42.863711 30317 leader_election.cc:343] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:42.869503 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:42.870149 30372 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:42.871182 30658 ts_tablet_manager.cc:1434] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260807 07:56:42.874655 30658 tablet_bootstrap.cc:492] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:42.875633 30689 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.878490 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:42.879065 30372 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.880821 30658 tablet_bootstrap.cc:654] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.886873 30743 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:42.887084 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:42.887329 30743 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.887634 30590 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.889665 30743 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.891669 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:42.892119 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:42.892280 30588 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:42.892757 30369 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:42.893620 30429 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:42.895134 30743 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:42.895488 30743 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:42.897825 30788 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.899087 30590 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:42.901407 30429 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:42.902272 30723 raft_consensus.cc:2804] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:42.902729 30723 raft_consensus.cc:697] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:42.903503 30723 consensus_queue.cc:237] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.905913 30654 tablet_bootstrap.cc:492] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:42.906378 30654 ts_tablet_manager.cc:1403] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.060s user 0.008s sys 0.004s
I20260807 07:56:42.907763 30743 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.909493 30689 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.908883 30654 raft_consensus.cc:359] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.910130 30654 raft_consensus.cc:385] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.910404 30654 raft_consensus.cc:740] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.911069 30654 consensus_queue.cc:260] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.916342 30653 tablet_bootstrap.cc:492] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:42.916787 30653 ts_tablet_manager.cc:1403] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.093s user 0.015s sys 0.025s
I20260807 07:56:42.919219 30654 ts_tablet_manager.cc:1434] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260807 07:56:42.919284 30653 raft_consensus.cc:359] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.919986 30653 raft_consensus.cc:385] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.920321 30654 tablet_bootstrap.cc:492] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:42.920868 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:42.921445 30590 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.926007 30372 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:42.926200 30222 catalog_manager.cc:5697] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:42.928526 30654 tablet_bootstrap.cc:654] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.914793 30743 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.931036 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:42.931593 30372 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.936556 30590 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:42.937767 30320 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:42.937681 30372 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:42.938855 30788 raft_consensus.cc:2804] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:42.939466 30788 raft_consensus.cc:697] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:42.939736 30429 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:42.940263 30788 consensus_queue.cc:237] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.944147 30743 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:42.944684 30743 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:42.945194 30654 tablet_bootstrap.cc:492] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:42.945660 30654 ts_tablet_manager.cc:1403] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.008s
I20260807 07:56:42.946125 30743 raft_consensus.cc:697] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:42.920261 30653 raft_consensus.cc:740] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.946159 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:42.947604 30588 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:42.947816 30653 consensus_queue.cc:260] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.950202 30653 ts_tablet_manager.cc:1434] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.033s user 0.006s sys 0.001s
I20260807 07:56:42.951172 30653 tablet_bootstrap.cc:492] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:42.946979 30743 consensus_queue.cc:237] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.956252 30588 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:42.957247 30654 raft_consensus.cc:359] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.957934 30654 raft_consensus.cc:385] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.958195 30654 raft_consensus.cc:740] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.960340 30653 tablet_bootstrap.cc:654] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.959154 30654 consensus_queue.cc:260] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.963867 30222 catalog_manager.cc:5697] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:42.966364 30654 ts_tablet_manager.cc:1434] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.020s user 0.003s sys 0.002s
I20260807 07:56:42.966490 30658 tablet_bootstrap.cc:492] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:42.968370 30658 ts_tablet_manager.cc:1403] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.094s user 0.033s sys 0.031s
I20260807 07:56:42.968896 30654 tablet_bootstrap.cc:492] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:42.971035 30658 raft_consensus.cc:359] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.971670 30658 raft_consensus.cc:385] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:42.971930 30658 raft_consensus.cc:740] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:42.972569 30658 consensus_queue.cc:260] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.974499 30658 ts_tablet_manager.cc:1434] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 07:56:42.975515 30658 tablet_bootstrap.cc:492] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:42.976442 30654 tablet_bootstrap.cc:654] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.981114 30658 tablet_bootstrap.cc:654] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:42.984606 30757 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:42.985118 30757 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:42.987279 30757 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:42.989468 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:42.991161 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:42.991629 30490 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:42.988468 30220 catalog_manager.cc:5697] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:42.992225 30367 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:42.994235 30541 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:42.997063 30757 raft_consensus.cc:2804] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:42.997555 30757 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:42.997951 30757 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.000838 30588 raft_consensus.cc:3060] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.007629 30757 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.012264 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:43.014398 30367 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.015702 30653 tablet_bootstrap.cc:492] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:43.016147 30653 ts_tablet_manager.cc:1403] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.065s user 0.005s sys 0.008s
I20260807 07:56:43.017666 30743 consensus_queue.cc:1048] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.018321 30654 tablet_bootstrap.cc:492] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:43.018770 30654 ts_tablet_manager.cc:1403] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.050s user 0.007s sys 0.009s
I20260807 07:56:43.019773 30653 raft_consensus.cc:359] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.020428 30653 raft_consensus.cc:385] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.020700 30653 raft_consensus.cc:740] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.021165 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:43.022086 30490 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.021370 30653 consensus_queue.cc:260] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.029893 30757 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:43.022516 30654 raft_consensus.cc:359] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.034987 30490 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:43.035511 30654 raft_consensus.cc:385] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.035854 30654 raft_consensus.cc:740] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.037431 30539 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:43.038443 30757 raft_consensus.cc:2804] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:43.039103 30653 ts_tablet_manager.cc:1434] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.023s user 0.005s sys 0.004s
I20260807 07:56:43.039397 30757 raft_consensus.cc:697] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:43.040205 30653 tablet_bootstrap.cc:492] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:43.041989 30658 tablet_bootstrap.cc:492] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:43.042459 30658 ts_tablet_manager.cc:1403] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.067s user 0.019s sys 0.022s
I20260807 07:56:43.042376 30788 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.043844 30654 consensus_queue.cc:260] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.045639 30654 ts_tablet_manager.cc:1434] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.027s user 0.009s sys 0.000s
I20260807 07:56:43.046762 30654 tablet_bootstrap.cc:492] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:43.046360 30658 raft_consensus.cc:359] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.047390 30658 raft_consensus.cc:385] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.047688 30658 raft_consensus.cc:740] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.048482 30658 consensus_queue.cc:260] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.041953 30757 consensus_queue.cc:237] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.057952 30658 ts_tablet_manager.cc:1434] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.015s user 0.008s sys 0.000s
I20260807 07:56:43.074340 30743 consensus_queue.cc:1048] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.067595 30367 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:43.079550 30658 tablet_bootstrap.cc:492] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:43.086721 30653 tablet_bootstrap.cc:654] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.091325 30654 tablet_bootstrap.cc:654] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.107802 30658 tablet_bootstrap.cc:654] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.115828 30667 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.133370 30654 tablet_bootstrap.cc:492] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:43.133960 30654 ts_tablet_manager.cc:1403] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.088s user 0.015s sys 0.017s
I20260807 07:56:43.136760 30654 raft_consensus.cc:359] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.137645 30654 raft_consensus.cc:385] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.137923 30654 raft_consensus.cc:740] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.138722 30654 consensus_queue.cc:260] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.144496 30654 ts_tablet_manager.cc:1434] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20260807 07:56:43.145550 30667 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:43.146139 30654 tablet_bootstrap.cc:492] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:43.146023 30667 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.148854 30667 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:43.150247 30653 tablet_bootstrap.cc:492] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:43.150671 30653 ts_tablet_manager.cc:1403] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.111s user 0.017s sys 0.004s
I20260807 07:56:43.151453 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:43.152096 30490 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:43.152014 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:43.153100 30317 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:43.153602 30588 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:43.154430 30667 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:43.154811 30667 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:43.155130 30667 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.155344 30653 raft_consensus.cc:359] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.155964 30653 raft_consensus.cc:385] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.156251 30653 raft_consensus.cc:740] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.156985 30653 consensus_queue.cc:260] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.155773 30220 catalog_manager.cc:5697] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:43.159024 30653 ts_tablet_manager.cc:1434] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 07:56:43.160154 30653 tablet_bootstrap.cc:492] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:43.165963 30653 tablet_bootstrap.cc:654] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.167568 30658 tablet_bootstrap.cc:492] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:43.168111 30658 ts_tablet_manager.cc:1403] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.089s user 0.011s sys 0.006s
I20260807 07:56:43.170614 30689 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:43.170883 30654 tablet_bootstrap.cc:654] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.171080 30689 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.170722 30658 raft_consensus.cc:359] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.171953 30658 raft_consensus.cc:385] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.172284 30658 raft_consensus.cc:740] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.163880 30667 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.173084 30689 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:43.174610 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:43.175222 30367 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:43.175774 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:43.176378 30490 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.176579 30429 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:43.178032 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:43.178596 30588 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:43.180227 30689 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:43.180589 30689 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:43.180891 30689 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.183863 30490 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:43.185125 30317 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:43.186089 30730 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:43.186550 30730 raft_consensus.cc:697] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:43.187332 30730 consensus_queue.cc:237] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.188223 30667 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:43.191783 30654 tablet_bootstrap.cc:492] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:43.192237 30654 ts_tablet_manager.cc:1403] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.047s user 0.011s sys 0.000s
I20260807 07:56:43.193517 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:43.194446 30588 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.194945 30654 raft_consensus.cc:359] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.195626 30775 consensus_queue.cc:1048] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.199470 30723 consensus_queue.cc:1048] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:43.199872 30654 raft_consensus.cc:385] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.200222 30654 raft_consensus.cc:740] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.201056 30654 consensus_queue.cc:260] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.203228 30654 ts_tablet_manager.cc:1434] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260807 07:56:43.204363 30654 tablet_bootstrap.cc:492] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:43.205212 30667 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:43.205767 30667 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.207820 30667 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:43.208843 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:43.209560 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:43.210211 30587 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:43.212051 30320 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:43.213660 30654 tablet_bootstrap.cc:654] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.216626 30689 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.217362 30788 raft_consensus.cc:2804] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:43.222631 30788 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:43.222975 30788 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.223762 30689 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:43.226369 30757 consensus_queue.cc:1048] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.232573 30788 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.221666 30658 consensus_queue.cc:260] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.221596 30588 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:43.271404 30490 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:43.246071 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:43.256739 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:43.272646 30372 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.255188 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:43.276831 30590 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.267951 30788 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:43.268985 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:43.247478 30653 tablet_bootstrap.cc:492] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:43.278048 30653 ts_tablet_manager.cc:1403] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.118s user 0.033s sys 0.013s
I20260807 07:56:43.285173 30658 ts_tablet_manager.cc:1434] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.117s user 0.008s sys 0.004s
I20260807 07:56:43.289987 30658 tablet_bootstrap.cc:492] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:43.292876 30653 raft_consensus.cc:359] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.293536 30653 raft_consensus.cc:385] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.293751 30653 raft_consensus.cc:740] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.294094 30372 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:43.294395 30653 consensus_queue.cc:260] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.295573 30587 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.295960 30653 ts_tablet_manager.cc:1434] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.018s user 0.003s sys 0.004s
I20260807 07:56:43.297461 30664 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:43.298079 30653 tablet_bootstrap.cc:492] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:43.268283 30654 tablet_bootstrap.cc:492] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:43.298851 30654 ts_tablet_manager.cc:1403] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.095s user 0.010s sys 0.014s
I20260807 07:56:43.298367 30664 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.300201 30429 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:43.304205 30723 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:43.304922 30723 raft_consensus.cc:697] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:43.311264 30664 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:43.314296 30730 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:43.314849 30730 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.313612 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:43.316021 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:43.316618 30372 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
W20260807 07:56:43.317137 30539 leader_election.cc:343] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:43.318176 30541 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:43.319631 30664 raft_consensus.cc:2804] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:43.320001 30664 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:43.320822 30664 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.316648 30220 catalog_manager.cc:5697] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:43.319878 30730 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:43.318321 30723 consensus_queue.cc:237] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.324105 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:56:43.325418 30317 leader_election.cc:343] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:43.325883 30654 raft_consensus.cc:359] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.326442 30654 raft_consensus.cc:385] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.326740 30654 raft_consensus.cc:740] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.320990 30590 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:43.328441 30654 consensus_queue.cc:260] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.329902 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:43.332886 30654 ts_tablet_manager.cc:1434] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.034s user 0.006s sys 0.001s
I20260807 07:56:43.334637 30664 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.340121 30654 tablet_bootstrap.cc:492] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:43.341813 30588 raft_consensus.cc:2393] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 1: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:56:43.341765 30749 consensus_queue.cc:1048] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.349679 30653 tablet_bootstrap.cc:654] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.350131 30320 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:43.351478 30730 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.351990 30664 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:43.355716 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:43.356438 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:56:43.367707 30539 leader_election.cc:343] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:43.374473 30658 tablet_bootstrap.cc:654] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.382100 30587 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:43.384122 30320 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:43.387084 30223 catalog_manager.cc:5697] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:43.388958 30788 raft_consensus.cc:2804] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:43.392503 30788 raft_consensus.cc:697] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:43.394236 30788 consensus_queue.cc:237] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.399993 30689 consensus_queue.cc:1048] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.407509 30723 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:43.414987 30743 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260807 07:56:43.423303 30653 tablet_bootstrap.cc:492] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:43.423940 30653 ts_tablet_manager.cc:1403] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.126s user 0.036s sys 0.025s
I20260807 07:56:43.425338 30730 raft_consensus.cc:2749] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:43.413232 30723 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.434798 30488 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.435120 30723 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:43.443233 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:43.446303 30653 raft_consensus.cc:359] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.447407 30653 raft_consensus.cc:385] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.447736 30653 raft_consensus.cc:740] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.450039 30654 tablet_bootstrap.cc:654] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.453111 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:43.454180 30590 raft_consensus.cc:2393] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:56:43.455626 30429 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:43.455617 30689 consensus_queue.cc:1048] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.459425 30658 tablet_bootstrap.cc:492] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:43.460037 30658 ts_tablet_manager.cc:1403] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.170s user 0.012s sys 0.012s
I20260807 07:56:43.488225 30658 raft_consensus.cc:359] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.488754 30658 raft_consensus.cc:385] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.488919 30658 raft_consensus.cc:740] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.490399 30658 consensus_queue.cc:260] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.492017 30653 consensus_queue.cc:260] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.493055 30743 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:43.495057 30658 ts_tablet_manager.cc:1434] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.035s user 0.004s sys 0.003s
I20260807 07:56:43.496420 30658 tablet_bootstrap.cc:492] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:43.496498 30869 consensus_queue.cc:1048] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 07:56:43.497242 30653 ts_tablet_manager.cc:1434] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.073s user 0.013s sys 0.001s
I20260807 07:56:43.498756 30653 tablet_bootstrap.cc:492] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:43.502121 30689 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.477308 30367 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:43.509764 30541 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:43.511571 30664 raft_consensus.cc:2804] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:43.512365 30664 raft_consensus.cc:697] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:43.513980 30664 consensus_queue.cc:237] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.515786 30689 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:43.517516 30689 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.546739 30689 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:43.551913 30658 tablet_bootstrap.cc:654] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.560047 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:43.561296 30367 raft_consensus.cc:2393] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:56:43.566093 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:43.572817 30667 consensus_queue.cc:1048] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.575700 30654 tablet_bootstrap.cc:492] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:43.576247 30654 ts_tablet_manager.cc:1403] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.236s user 0.028s sys 0.007s
I20260807 07:56:43.579038 30749 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:43.582031 30654 raft_consensus.cc:359] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.582809 30654 raft_consensus.cc:385] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.583149 30654 raft_consensus.cc:740] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.584080 30654 consensus_queue.cc:260] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:56:43.585539 30294 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:56:43.586920 30654 ts_tablet_manager.cc:1434] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.010s user 0.004s sys 0.003s
I20260807 07:56:43.588083 30654 tablet_bootstrap.cc:492] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:43.607973 30429 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:43.610059 30775 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.620155 30653 tablet_bootstrap.cc:654] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.628497 30658 tablet_bootstrap.cc:492] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:43.628984 30658 ts_tablet_manager.cc:1403] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.133s user 0.018s sys 0.018s
I20260807 07:56:43.649646 30223 catalog_manager.cc:5697] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:43.650362 30658 raft_consensus.cc:359] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.651242 30658 raft_consensus.cc:385] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.651594 30658 raft_consensus.cc:740] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.652311 30658 consensus_queue.cc:260] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.657899 30664 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.648152 30775 raft_consensus.cc:2749] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:43.685446 30658 ts_tablet_manager.cc:1434] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.056s user 0.017s sys 0.017s
I20260807 07:56:43.686529 30664 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:43.687299 30664 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.689196 30654 tablet_bootstrap.cc:654] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.693274 30664 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:43.693742 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:43.695849 30372 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:43.698408 30658 tablet_bootstrap.cc:492] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:43.700631 30541 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:43.703945 30664 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:43.704442 30664 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:43.704893 30664 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.698285 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:43.710071 30490 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:43.719523 30723 consensus_queue.cc:1048] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.717262 30664 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.727244 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:43.727872 30490 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.729101 30664 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:43.733556 30220 catalog_manager.cc:5697] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:43.747452 30667 consensus_queue.cc:1048] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.753113 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:43.753923 30373 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.754070 30653 tablet_bootstrap.cc:492] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:43.755657 30653 ts_tablet_manager.cc:1403] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.257s user 0.010s sys 0.012s
I20260807 07:56:43.781035 30653 raft_consensus.cc:359] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.781802 30653 raft_consensus.cc:385] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.782094 30653 raft_consensus.cc:740] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.782738 30653 consensus_queue.cc:260] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.790134 30490 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:43.791491 30653 ts_tablet_manager.cc:1434] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.036s user 0.008s sys 0.000s
I20260807 07:56:43.793067 30653 tablet_bootstrap.cc:492] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:43.797797 30654 tablet_bootstrap.cc:492] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:43.798341 30654 ts_tablet_manager.cc:1403] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.211s user 0.042s sys 0.053s
I20260807 07:56:43.802166 30654 raft_consensus.cc:359] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.804780 30654 raft_consensus.cc:385] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.805119 30654 raft_consensus.cc:740] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.805900 30654 consensus_queue.cc:260] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.809759 30689 consensus_queue.cc:1048] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:43.810990 30373 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:43.812433 30539 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:43.814996 30654 ts_tablet_manager.cc:1434] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260807 07:56:43.816220 30654 tablet_bootstrap.cc:492] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:43.823750 30825 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:43.824416 30825 raft_consensus.cc:697] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:43.825702 30825 consensus_queue.cc:237] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.828261 30658 tablet_bootstrap.cc:654] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.835155 30654 tablet_bootstrap.cc:654] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.847564 30653 tablet_bootstrap.cc:654] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:43.848479 30869 consensus_queue.cc:1048] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.892697 30654 tablet_bootstrap.cc:492] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:43.893234 30654 ts_tablet_manager.cc:1403] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.077s user 0.011s sys 0.006s
I20260807 07:56:43.900067 30488 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:43.903216 30654 raft_consensus.cc:359] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.904124 30654 raft_consensus.cc:385] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:43.904408 30654 raft_consensus.cc:740] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:43.905081 30654 consensus_queue.cc:260] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:43.905836 30869 consensus_queue.cc:1048] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:43.907308 30654 ts_tablet_manager.cc:1434] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260807 07:56:43.884567 30220 catalog_manager.cc:5697] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:43.922665 30825 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:43.926920 30658 tablet_bootstrap.cc:492] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:43.928099 30658 ts_tablet_manager.cc:1403] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.230s user 0.014s sys 0.031s
I20260807 07:56:43.927161 30869 consensus_queue.cc:1048] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:43.941972 30654 tablet_bootstrap.cc:492] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:43.985011 30749 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:43.985836 30749 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.004050 30658 raft_consensus.cc:359] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.004797 30658 raft_consensus.cc:385] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.005080 30658 raft_consensus.cc:740] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.005287 30749 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:44.005757 30658 consensus_queue.cc:260] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.007412 30658 ts_tablet_manager.cc:1434] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.078s user 0.013s sys 0.010s
I20260807 07:56:44.008639 30658 tablet_bootstrap.cc:492] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:44.015058 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:44.015925 30487 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:44.018712 30539 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:44.024238 30825 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:44.024950 30825 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.026654 30658 tablet_bootstrap.cc:654] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.027840 30825 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:44.024188 30664 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:44.028585 30664 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:44.029009 30664 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.036294 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:44.037792 30869 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:44.039707 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:56:44.041920 30541 leader_election.cc:343] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.038470 30869 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.047531 30869 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:44.050400 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:44.052781 30653 tablet_bootstrap.cc:492] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:44.053298 30653 ts_tablet_manager.cc:1403] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.260s user 0.011s sys 0.028s
I20260807 07:56:44.051255 30490 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:44.043277 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:44.061674 30317 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:44.062964 30664 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:56:44.066146 30539 leader_election.cc:343] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.066751 30539 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:44.067478 30653 raft_consensus.cc:359] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.067962 30749 raft_consensus.cc:2749] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:44.051856 30373 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:44.070535 30653 raft_consensus.cc:385] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.070760 30653 raft_consensus.cc:740] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.071250 30788 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:44.053264 30825 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260807 07:56:44.075282 30664 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:44.076617 30788 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:44.077346 30788 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.086748 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:44.079493 30653 consensus_queue.cc:260] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.087920 30490 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.092381 30654 tablet_bootstrap.cc:654] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.102613 30653 ts_tablet_manager.cc:1434] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.049s user 0.005s sys 0.009s
I20260807 07:56:44.102268 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:44.103421 30588 raft_consensus.cc:2393] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 1: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:56:44.103607 30653 tablet_bootstrap.cc:492] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:44.103688 30658 tablet_bootstrap.cc:492] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:44.104792 30658 ts_tablet_manager.cc:1403] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.096s user 0.029s sys 0.009s
I20260807 07:56:44.107316 30490 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:44.112464 30658 raft_consensus.cc:359] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.113101 30658 raft_consensus.cc:385] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.113440 30658 raft_consensus.cc:740] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.114152 30658 consensus_queue.cc:260] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.113677 30788 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.117836 30658 ts_tablet_manager.cc:1434] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20260807 07:56:44.118613 30539 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:44.120235 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:44.120602 30825 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:44.121475 30825 raft_consensus.cc:697] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:44.118880 30658 tablet_bootstrap.cc:492] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:44.122629 30373 raft_consensus.cc:2393] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 1: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:56:44.122653 30825 consensus_queue.cc:237] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.169497 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:44.170464 30490 raft_consensus.cc:2393] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 1: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:56:44.176060 30653 tablet_bootstrap.cc:654] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
W20260807 07:56:44.177641 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 47529.1us
I20260807 07:56:44.161473 30788 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:44.190166 30775 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:44.194824 30775 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.199347 30658 tablet_bootstrap.cc:654] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.207492 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:44.208621 30372 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:44.212780 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:44.213579 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:44.218879 30654 tablet_bootstrap.cc:492] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:44.219350 30654 ts_tablet_manager.cc:1403] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.287s user 0.040s sys 0.022s
I20260807 07:56:44.200776 30775 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:44.223572 30654 raft_consensus.cc:359] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.225184 30654 raft_consensus.cc:385] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.215471 30429 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:56:44.227285 30429 leader_election.cc:343] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.229074 30743 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:44.229701 30743 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:44.230129 30743 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.230393 30320 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:44.233871 30869 raft_consensus.cc:2749] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 07:56:44.225509 30654 raft_consensus.cc:740] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.236114 30654 consensus_queue.cc:260] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.238201 30654 ts_tablet_manager.cc:1434] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20260807 07:56:44.239319 30654 tablet_bootstrap.cc:492] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:44.246428 30653 tablet_bootstrap.cc:492] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:44.248306 30653 ts_tablet_manager.cc:1403] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.145s user 0.012s sys 0.014s
I20260807 07:56:44.252908 30749 consensus_queue.cc:1048] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:44.256619 30653 raft_consensus.cc:359] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.257164 30653 raft_consensus.cc:385] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.257359 30653 raft_consensus.cc:740] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.258787 30653 consensus_queue.cc:260] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.256099 30743 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.267732 30658 tablet_bootstrap.cc:492] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:44.268177 30658 ts_tablet_manager.cc:1403] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.150s user 0.010s sys 0.009s
I20260807 07:56:44.262542 30220 catalog_manager.cc:5697] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:44.273450 30658 raft_consensus.cc:359] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.274178 30658 raft_consensus.cc:385] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.274446 30658 raft_consensus.cc:740] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.275206 30658 consensus_queue.cc:260] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.280381 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:44.282670 30653 ts_tablet_manager.cc:1434] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.034s user 0.002s sys 0.004s
I20260807 07:56:44.285461 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:44.287325 30653 tablet_bootstrap.cc:492] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:44.289227 30743 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:44.288847 30654 tablet_bootstrap.cc:654] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.281170 30367 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.283257 30658 ts_tablet_manager.cc:1434] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.009s user 0.003s sys 0.003s
I20260807 07:56:44.308501 30658 tablet_bootstrap.cc:492] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:44.308583 30367 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:44.308730 30749 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:44.309271 30749 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.311722 30749 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:56:44.314486 30429 leader_election.cc:343] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.316039 30429 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:44.317855 30743 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:44.317894 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:44.318444 30743 raft_consensus.cc:697] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:44.318602 30488 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:44.319289 30743 consensus_queue.cc:237] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.320113 30658 tablet_bootstrap.cc:654] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.323161 30539 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:44.324123 30749 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:44.324471 30749 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:44.324785 30749 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.327277 30653 tablet_bootstrap.cc:654] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.341807 30664 consensus_queue.cc:1048] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260807 07:56:44.335212 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:56:44.356678 30541 leader_election.cc:343] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.387068 30223 catalog_manager.cc:5697] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:44.389921 30654 tablet_bootstrap.cc:492] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:44.393543 30654 ts_tablet_manager.cc:1403] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.154s user 0.015s sys 0.009s
I20260807 07:56:44.400833 30653 tablet_bootstrap.cc:492] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:44.404497 30653 ts_tablet_manager.cc:1403] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.117s user 0.007s sys 0.012s
I20260807 07:56:44.408344 30749 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.412056 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:56:44.413761 30541 leader_election.cc:343] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.414119 30658 tablet_bootstrap.cc:492] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:44.416612 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:44.417614 30490 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.421470 30653 raft_consensus.cc:359] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.422778 30653 raft_consensus.cc:385] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.423120 30653 raft_consensus.cc:740] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.422295 30658 ts_tablet_manager.cc:1403] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.114s user 0.011s sys 0.010s
I20260807 07:56:44.427906 30653 consensus_queue.cc:260] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.428158 30490 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:44.427038 30658 raft_consensus.cc:359] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.428843 30749 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:44.429438 30658 raft_consensus.cc:385] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.429767 30658 raft_consensus.cc:740] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.430657 30658 consensus_queue.cc:260] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.432896 30658 ts_tablet_manager.cc:1434] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260807 07:56:44.403618 30654 raft_consensus.cc:359] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.433542 30654 raft_consensus.cc:385] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.433915 30654 raft_consensus.cc:740] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.434100 30658 tablet_bootstrap.cc:492] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:44.434518 30539 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:56:44.435949 30749 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:44.437628 30749 raft_consensus.cc:697] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:44.438387 30653 ts_tablet_manager.cc:1434] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.033s user 0.006s sys 0.002s
I20260807 07:56:44.434659 30654 consensus_queue.cc:260] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.439523 30653 tablet_bootstrap.cc:492] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:44.438935 30749 consensus_queue.cc:237] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.440941 30654 ts_tablet_manager.cc:1434] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.044s user 0.003s sys 0.003s
I20260807 07:56:44.442194 30654 tablet_bootstrap.cc:492] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:44.455132 30654 tablet_bootstrap.cc:654] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.457650 30223 catalog_manager.cc:5697] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:44.466615 30653 tablet_bootstrap.cc:654] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.468927 30658 tablet_bootstrap.cc:654] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.495461 30653 tablet_bootstrap.cc:492] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:44.495997 30653 ts_tablet_manager.cc:1403] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.057s user 0.010s sys 0.008s
I20260807 07:56:44.501785 30749 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:44.501896 30653 raft_consensus.cc:359] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.502748 30653 raft_consensus.cc:385] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.503106 30653 raft_consensus.cc:740] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.502578 30749 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.503929 30658 tablet_bootstrap.cc:492] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:44.504372 30658 ts_tablet_manager.cc:1403] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.071s user 0.011s sys 0.019s
I20260807 07:56:44.504628 30653 consensus_queue.cc:260] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.506887 30653 ts_tablet_manager.cc:1434] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260807 07:56:44.507838 30653 tablet_bootstrap.cc:492] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:44.507838 30658 raft_consensus.cc:359] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.508589 30658 raft_consensus.cc:385] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.508704 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:44.508878 30658 raft_consensus.cc:740] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.510049 30658 consensus_queue.cc:260] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.511272 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:44.518888 30654 tablet_bootstrap.cc:492] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:44.519411 30654 ts_tablet_manager.cc:1403] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.078s user 0.008s sys 0.015s
I20260807 07:56:44.519598 30658 ts_tablet_manager.cc:1434] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.015s user 0.004s sys 0.004s
W20260807 07:56:44.520236 30539 leader_election.cc:343] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.521286 30658 tablet_bootstrap.cc:492] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
W20260807 07:56:44.521721 30541 leader_election.cc:343] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.522403 30541 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:44.524649 30823 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:44.517272 30749 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:44.532806 30653 tablet_bootstrap.cc:654] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.536415 30658 tablet_bootstrap.cc:654] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.540958 30654 raft_consensus.cc:359] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.541764 30654 raft_consensus.cc:385] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.542052 30654 raft_consensus.cc:740] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.542694 30654 consensus_queue.cc:260] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.543938 30658 tablet_bootstrap.cc:492] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:44.544440 30658 ts_tablet_manager.cc:1403] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.005s
I20260807 07:56:44.546979 30654 ts_tablet_manager.cc:1434] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.027s user 0.007s sys 0.002s
I20260807 07:56:44.548100 30654 tablet_bootstrap.cc:492] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:44.548170 30723 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:44.548940 30723 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.551014 30749 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:44.551851 30723 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:44.554605 30658 raft_consensus.cc:359] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.554904 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:44.555264 30658 raft_consensus.cc:385] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.555537 30658 raft_consensus.cc:740] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.555567 30372 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:44.556257 30658 consensus_queue.cc:260] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.557199 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:44.558382 30658 ts_tablet_manager.cc:1434] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.014s user 0.005s sys 0.001s
I20260807 07:56:44.559453 30658 tablet_bootstrap.cc:492] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
W20260807 07:56:44.559875 30429 leader_election.cc:343] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.565675 30653 tablet_bootstrap.cc:492] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:44.566174 30653 ts_tablet_manager.cc:1403] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.059s user 0.006s sys 0.012s
I20260807 07:56:44.567142 30429 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:44.568389 30654 tablet_bootstrap.cc:654] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.568423 30723 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:44.569361 30723 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:44.569954 30653 raft_consensus.cc:359] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.570638 30653 raft_consensus.cc:385] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.570950 30658 tablet_bootstrap.cc:654] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.570910 30653 raft_consensus.cc:740] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.569883 30723 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.571871 30653 consensus_queue.cc:260] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.576470 30653 ts_tablet_manager.cc:1434] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.010s user 0.005s sys 0.003s
I20260807 07:56:44.577994 30653 tablet_bootstrap.cc:492] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:44.579434 30730 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:44.580029 30730 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.584323 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:56:44.594218 30317 leader_election.cc:343] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.596549 30869 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:44.597208 30869 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.600107 30653 tablet_bootstrap.cc:654] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.600062 30869 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:44.605782 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:44.605979 30730 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:44.615899 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:44.616490 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:56:44.616760 30317 leader_election.cc:343] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.616590 30586 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
W20260807 07:56:44.619923 30320 leader_election.cc:343] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.619990 30749 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:44.620440 30320 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:44.624373 30320 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:44.625675 30869 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:44.626514 30869 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:44.627104 30869 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:44.630066 30869 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.700240 30912 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:44.701064 30912 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.711984 30869 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.722200 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:44.723230 30653 tablet_bootstrap.cc:492] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:44.723109 30367 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:44.723716 30653 ts_tablet_manager.cc:1403] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.146s user 0.029s sys 0.036s
I20260807 07:56:44.725039 30429 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:44.726387 30743 raft_consensus.cc:2804] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:44.726990 30743 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:44.727355 30653 raft_consensus.cc:359] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.728080 30653 raft_consensus.cc:385] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.728322 30653 raft_consensus.cc:740] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.729075 30743 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.729085 30653 consensus_queue.cc:260] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.732569 30653 ts_tablet_manager.cc:1434] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20260807 07:56:44.733672 30653 tablet_bootstrap.cc:492] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:44.734706 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:44.728238 30912 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:44.744338 30775 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:44.735765 30586 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:44.778604 30658 tablet_bootstrap.cc:492] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:44.780476 30658 ts_tablet_manager.cc:1403] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.221s user 0.037s sys 0.057s
I20260807 07:56:44.755785 30775 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.776273 30869 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:44.789738 30825 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:44.793919 30825 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.795953 30658 raft_consensus.cc:359] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.797268 30658 raft_consensus.cc:385] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.797631 30658 raft_consensus.cc:740] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.794013 30743 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.801533 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:44.802310 30586 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.802757 30743 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:44.813989 30658 consensus_queue.cc:260] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.801247 30775 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:44.827600 30658 ts_tablet_manager.cc:1434] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.047s user 0.000s sys 0.008s
I20260807 07:56:44.827744 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:44.843478 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:44.844224 30585 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.844915 30825 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:44.845957 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:44.857084 30658 tablet_bootstrap.cc:492] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
W20260807 07:56:44.857139 30429 leader_election.cc:343] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.858193 30654 tablet_bootstrap.cc:492] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:44.858768 30654 ts_tablet_manager.cc:1403] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.311s user 0.064s sys 0.089s
I20260807 07:56:44.864598 30723 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:56:44.868407 30317 leader_election.cc:343] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.870422 30586 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:44.871182 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:44.871788 30482 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:44.873361 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:44.879197 30653 tablet_bootstrap.cc:654] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:44.881989 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:44.885804 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:44.877600 30723 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:44.887492 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:44.888007 30367 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.888547 30654 raft_consensus.cc:359] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.889195 30654 raft_consensus.cc:385] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:44.889482 30654 raft_consensus.cc:740] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:44.889497 30320 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:44.890111 30654 consensus_queue.cc:260] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.892088 30654 ts_tablet_manager.cc:1434] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.033s user 0.001s sys 0.003s
I20260807 07:56:44.893285 30585 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
W20260807 07:56:44.894912 30429 leader_election.cc:343] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.895530 30429 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:44.896967 30723 raft_consensus.cc:2804] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:44.897215 30539 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:44.897535 30723 raft_consensus.cc:697] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:44.898754 30823 raft_consensus.cc:2804] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:44.899138 30823 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:44.898578 30723 consensus_queue.cc:237] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:56:44.900908 30541 consensus_peers.cc:597] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e -> Peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Couldn't send request to peer b1188d7d3a0b455894bc443d571f6a19. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:44.900689 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:44.902295 30869 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:44.902568 30366 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.902827 30869 raft_consensus.cc:697] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
W20260807 07:56:44.901939 30429 leader_election.cc:343] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.903750 30429 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:44.899499 30823 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:44.909132 30654 tablet_bootstrap.cc:492] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:44.908304 30942 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 07:56:44.913327 30541 leader_election.cc:343] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:44.906785 30869 consensus_queue.cc:237] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.929986 30941 consensus_queue.cc:1048] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260807 07:56:44.914343 30367 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
W20260807 07:56:44.949033 30429 consensus_peers.cc:597] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 -> Peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Couldn't send request to peer f831a53ec51d452398015797d543164e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:44.949605 30825 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 07:56:44.972488 30294 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:56:44.973143 30221 catalog_manager.cc:5697] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:44.976694 30223 catalog_manager.cc:5697] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:44.994457 30653 tablet_bootstrap.cc:492] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:44.994911 30653 ts_tablet_manager.cc:1403] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.261s user 0.017s sys 0.008s
I20260807 07:56:44.997187 30823 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:44.999998 30823 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:45.005950 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:45.008347 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:45.009007 30490 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.009259 30653 raft_consensus.cc:359] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.010010 30653 raft_consensus.cc:385] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.010308 30653 raft_consensus.cc:740] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:45.011018 30653 consensus_queue.cc:260] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:56:45.011439 30541 leader_election.cc:343] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:45.013442 30653 ts_tablet_manager.cc:1434] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260807 07:56:45.014436 30653 tablet_bootstrap.cc:492] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:45.003762 30366 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:45.016002 30658 tablet_bootstrap.cc:654] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.018558 30429 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:45.020880 30490 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:45.020948 30941 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:45.021605 30941 raft_consensus.cc:697] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:45.022456 30941 consensus_queue.cc:237] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.023510 30654 tablet_bootstrap.cc:654] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.023897 30539 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:56:45.027930 30749 raft_consensus.cc:2804] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:45.028399 30749 raft_consensus.cc:697] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:45.029230 30749 consensus_queue.cc:237] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.031646 30653 tablet_bootstrap.cc:654] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.049593 30658 tablet_bootstrap.cc:492] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:45.050101 30658 ts_tablet_manager.cc:1403] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.215s user 0.012s sys 0.010s
I20260807 07:56:45.054795 30658 raft_consensus.cc:359] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.055295 30658 raft_consensus.cc:385] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.055544 30658 raft_consensus.cc:740] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:45.058121 30658 consensus_queue.cc:260] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.064219 30658 ts_tablet_manager.cc:1434] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.014s user 0.006s sys 0.001s
I20260807 07:56:45.068647 30658 tablet_bootstrap.cc:492] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:45.073347 30221 catalog_manager.cc:5697] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:45.074137 30941 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:45.074721 30941 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.078222 30941 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.073868 30653 tablet_bootstrap.cc:492] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:45.079118 30653 ts_tablet_manager.cc:1403] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.065s user 0.006s sys 0.011s
I20260807 07:56:45.078850 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:45.080322 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:45.080657 30367 raft_consensus.cc:2468] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
W20260807 07:56:45.082472 30429 leader_election.cc:343] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:45.083514 30429 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:45.077196 30220 catalog_manager.cc:5697] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:45.087397 30654 tablet_bootstrap.cc:492] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:45.087816 30654 ts_tablet_manager.cc:1403] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.188s user 0.011s sys 0.014s
I20260807 07:56:45.091321 30653 raft_consensus.cc:359] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.091998 30653 raft_consensus.cc:385] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.092252 30653 raft_consensus.cc:740] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:45.092931 30653 consensus_queue.cc:260] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.088040 30941 raft_consensus.cc:2804] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:45.093732 30941 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:45.094210 30941 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.095333 30653 ts_tablet_manager.cc:1434] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.016s user 0.003s sys 0.003s
I20260807 07:56:45.096357 30653 tablet_bootstrap.cc:492] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:45.104004 30654 raft_consensus.cc:359] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.104681 30654 raft_consensus.cc:385] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.104940 30654 raft_consensus.cc:740] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:45.105151 30658 tablet_bootstrap.cc:654] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.105563 30654 consensus_queue.cc:260] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.115754 30654 ts_tablet_manager.cc:1434] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.028s user 0.004s sys 0.004s
I20260807 07:56:45.118791 30654 tablet_bootstrap.cc:492] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:45.115047 30941 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.131705 30941 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.132958 30653 tablet_bootstrap.cc:654] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.135041 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:45.135785 30367 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.135653 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:56:45.145756 30429 leader_election.cc:343] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:45.150074 30658 tablet_bootstrap.cc:492] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:45.150619 30658 ts_tablet_manager.cc:1403] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.082s user 0.014s sys 0.009s
I20260807 07:56:45.151906 30654 tablet_bootstrap.cc:654] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.159302 30367 raft_consensus.cc:2468] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:45.160858 30429 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:45.162102 30723 raft_consensus.cc:2804] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:45.162776 30723 raft_consensus.cc:697] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:45.162890 30943 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:45.163724 30943 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.164055 30723 consensus_queue.cc:237] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.169755 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:45.171744 30490 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:45.172289 30658 raft_consensus.cc:359] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.172956 30658 raft_consensus.cc:385] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.173225 30658 raft_consensus.cc:740] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:45.173405 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:45.173614 30317 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:45.174196 30658 consensus_queue.cc:260] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.168354 30943 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.174908 30869 raft_consensus.cc:2804] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260807 07:56:45.175381 30320 leader_election.cc:343] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:45.175727 30869 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:45.176446 30658 ts_tablet_manager.cc:1434] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.026s user 0.008s sys 0.018s
I20260807 07:56:45.176721 30869 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.177712 30658 tablet_bootstrap.cc:492] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:45.186950 30658 tablet_bootstrap.cc:654] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.186870 30788 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:45.188083 30653 tablet_bootstrap.cc:492] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:45.187700 30788 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.188573 30653 ts_tablet_manager.cc:1403] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.092s user 0.017s sys 0.004s
I20260807 07:56:45.191809 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:45.191908 30653 raft_consensus.cc:359] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.192696 30653 raft_consensus.cc:385] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.192970 30653 raft_consensus.cc:740] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:45.193608 30653 consensus_queue.cc:260] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:56:45.194094 30317 leader_election.cc:343] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:45.195441 30788 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.198235 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:45.199168 30586 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:45.200721 30869 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.197634 30653 ts_tablet_manager.cc:1434] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.009s user 0.005s sys 0.004s
I20260807 07:56:45.204649 30653 tablet_bootstrap.cc:492] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:45.203073 30320 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:45.205845 30788 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:45.206373 30788 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:45.206776 30788 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.212783 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:45.221318 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:56:45.222210 30320 leader_election.cc:343] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:45.224372 30482 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.211297 30869 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.232503 30943 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:45.245314 30941 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:45.246219 30941 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.254722 30654 tablet_bootstrap.cc:492] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:45.255203 30654 ts_tablet_manager.cc:1403] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.137s user 0.014s sys 0.014s
I20260807 07:56:45.244123 30943 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.261307 30943 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.262960 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:56:45.266203 30317 leader_election.cc:343] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:45.267458 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:45.268931 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:45.274219 30653 tablet_bootstrap.cc:654] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
W20260807 07:56:45.276280 30320 leader_election.cc:343] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:45.276751 30320 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:45.283661 30869 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:45.289840 30941 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.291787 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:45.292658 30588 raft_consensus.cc:2393] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:56:45.294124 30429 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:45.295418 30941 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.301050 30658 tablet_bootstrap.cc:492] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:45.301525 30658 ts_tablet_manager.cc:1403] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.124s user 0.030s sys 0.045s
I20260807 07:56:45.304308 30658 raft_consensus.cc:359] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.304917 30658 raft_consensus.cc:385] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.305190 30658 raft_consensus.cc:740] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:45.306403 30658 consensus_queue.cc:260] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.308324 30658 ts_tablet_manager.cc:1434] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 07:56:45.308862 30220 catalog_manager.cc:5697] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:45.309254 30658 tablet_bootstrap.cc:492] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:45.310806 30941 raft_consensus.cc:2749] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:45.311898 30869 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:45.312354 30869 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.313916 30654 raft_consensus.cc:359] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.314303 30869 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.314566 30654 raft_consensus.cc:385] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.314844 30654 raft_consensus.cc:740] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:45.315544 30654 consensus_queue.cc:260] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.316267 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:45.316924 30490 raft_consensus.cc:2393] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 1: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:56:45.316969 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:45.320077 30653 tablet_bootstrap.cc:492] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:45.320220 30320 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:45.320524 30653 ts_tablet_manager.cc:1403] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.116s user 0.012s sys 0.009s
I20260807 07:56:45.321249 30869 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.321076 30788 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.333519 30788 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.334357 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:56:45.336012 30317 leader_election.cc:343] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:45.338260 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:45.323657 30654 ts_tablet_manager.cc:1434] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.068s user 0.006s sys 0.000s
I20260807 07:56:45.336969 30653 raft_consensus.cc:359] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.338877 30588 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.339190 30653 raft_consensus.cc:385] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.339486 30653 raft_consensus.cc:740] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:45.340202 30654 tablet_bootstrap.cc:492] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:45.340137 30653 consensus_queue.cc:260] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.342128 30658 tablet_bootstrap.cc:654] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.346761 30653 ts_tablet_manager.cc:1434] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.026s user 0.003s sys 0.006s
I20260807 07:56:45.348588 30482 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:45.349125 30654 tablet_bootstrap.cc:654] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.349766 30588 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:45.350824 30320 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:45.350827 30788 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:45.354301 30653 tablet_bootstrap.cc:492] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:45.352799 30943 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:45.354293 30317 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:45.355346 30943 raft_consensus.cc:697] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:45.355661 30730 raft_consensus.cc:2804] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:45.356279 30730 raft_consensus.cc:697] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:45.356773 30943 consensus_queue.cc:237] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.357455 30730 consensus_queue.cc:237] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.353358 30788 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.362998 30658 tablet_bootstrap.cc:492] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:45.363440 30658 ts_tablet_manager.cc:1403] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.054s user 0.008s sys 0.004s
I20260807 07:56:45.370085 30653 tablet_bootstrap.cc:654] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.377715 30869 raft_consensus.cc:2749] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:45.381632 30788 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.382174 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:45.383723 30658 raft_consensus.cc:359] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.384444 30658 raft_consensus.cc:385] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.384749 30658 raft_consensus.cc:740] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:45.385577 30658 consensus_queue.cc:260] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.392813 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:45.395004 30658 ts_tablet_manager.cc:1434] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.031s user 0.007s sys 0.003s
I20260807 07:56:45.408306 30658 tablet_bootstrap.cc:492] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:45.413329 30823 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:45.413813 30941 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:45.399814 30978 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:45.408608 30367 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.401472 30317 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:45.433414 30220 catalog_manager.cc:5697] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:45.440568 30220 catalog_manager.cc:5697] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:45.449409 30658 tablet_bootstrap.cc:654] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.450340 30743 consensus_queue.cc:1048] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:45.450632 30588 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
W20260807 07:56:45.451510 30429 consensus_peers.cc:597] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 -> Peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Couldn't send request to peer f831a53ec51d452398015797d543164e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:45.456660 30653 tablet_bootstrap.cc:492] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:45.457149 30653 ts_tablet_manager.cc:1403] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.103s user 0.007s sys 0.016s
I20260807 07:56:45.461813 30654 tablet_bootstrap.cc:492] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:45.462306 30654 ts_tablet_manager.cc:1403] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.122s user 0.011s sys 0.013s
I20260807 07:56:45.463975 30653 raft_consensus.cc:359] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.464684 30653 raft_consensus.cc:385] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.464929 30653 raft_consensus.cc:740] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:45.465871 30653 consensus_queue.cc:260] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.469045 30653 ts_tablet_manager.cc:1434] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260807 07:56:45.470048 30653 tablet_bootstrap.cc:492] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:45.470701 30654 raft_consensus.cc:359] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.471364 30654 raft_consensus.cc:385] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.471619 30654 raft_consensus.cc:740] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:45.475175 30654 consensus_queue.cc:260] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.485859 30654 ts_tablet_manager.cc:1434] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.023s user 0.003s sys 0.004s
I20260807 07:56:45.486025 30825 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:45.487046 30654 tablet_bootstrap.cc:492] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:45.506488 30743 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:45.524864 30730 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:45.558789 30723 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:45.577598 30723 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.629753 30654 tablet_bootstrap.cc:654] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.628978 30942 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:45.642422 30942 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.627305 30723 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.650233 30942 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.719277 30869 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:45.719942 30869 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.738240 30788 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:45.748657 30658 tablet_bootstrap.cc:492] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:45.751786 30653 tablet_bootstrap.cc:654] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.752194 30658 ts_tablet_manager.cc:1403] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.344s user 0.037s sys 0.044s
I20260807 07:56:45.756006 30749 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:56:45.758953 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 146329us
I20260807 07:56:45.761166 30749 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.764233 30749 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:45.767304 30869 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.770574 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:45.771313 30490 raft_consensus.cc:2393] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 1: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:56:45.774058 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:45.782155 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:56:45.795907 30320 leader_election.cc:343] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:45.798756 30658 raft_consensus.cc:359] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.799588 30658 raft_consensus.cc:385] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.799870 30658 raft_consensus.cc:740] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:45.800581 30658 consensus_queue.cc:260] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.806743 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:56:45.809948 30317 leader_election.cc:343] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:45.813917 30541 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:45.815230 30658 ts_tablet_manager.cc:1434] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.063s user 0.007s sys 0.000s
I20260807 07:56:45.816771 30658 tablet_bootstrap.cc:492] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:45.817165 30317 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:45.818665 30788 raft_consensus.cc:2749] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:45.838790 30654 tablet_bootstrap.cc:492] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:45.839349 30654 ts_tablet_manager.cc:1403] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.353s user 0.014s sys 0.022s
I20260807 07:56:45.840523 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:45.846740 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:45.847342 30367 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:45.827812 30664 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.856069 30654 raft_consensus.cc:359] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.856809 30654 raft_consensus.cc:385] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.857095 30654 raft_consensus.cc:740] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
W20260807 07:56:45.858258 30429 leader_election.cc:343] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
W20260807 07:56:45.860925 30317 consensus_peers.cc:597] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 -> Peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Couldn't send request to peer ef1ca7acf52a438f89f14707e9e06818. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:45.862098 30429 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:45.862933 30997 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:45.863472 30997 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:45.863987 30997 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.873895 30654 consensus_queue.cc:260] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.876550 30654 ts_tablet_manager.cc:1434] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.037s user 0.004s sys 0.004s
I20260807 07:56:45.874212 30998 consensus_queue.cc:1048] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:45.877506 30654 tablet_bootstrap.cc:492] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:45.883421 30653 tablet_bootstrap.cc:492] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:45.883895 30653 ts_tablet_manager.cc:1403] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.414s user 0.017s sys 0.027s
I20260807 07:56:45.884547 30825 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:45.885010 30825 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.886472 30653 raft_consensus.cc:359] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.887132 30653 raft_consensus.cc:385] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:45.887399 30653 raft_consensus.cc:740] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
W20260807 07:56:45.887588 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 59334.9us
I20260807 07:56:45.893024 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:45.893503 30825 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:45.893795 30366 raft_consensus.cc:2393] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 1: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:56:45.895443 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:45.895789 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:45.896371 30585 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:45.899521 30653 consensus_queue.cc:260] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.901449 30653 ts_tablet_manager.cc:1434] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260807 07:56:45.911026 30997 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:45.915217 30590 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.921617 30653 tablet_bootstrap.cc:492] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:45.918169 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:45.922441 30585 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:45.930986 30869 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:45.936201 30654 tablet_bootstrap.cc:654] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.941834 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:45.944134 30997 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:45.945871 30372 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.950433 30429 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:56:45.952148 30912 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:45.952674 30912 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:45.953227 30912 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:45.933516 30664 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:45.965584 30658 tablet_bootstrap.cc:654] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:45.978924 30541 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:45.979799 30664 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:45.992334 30996 consensus_queue.cc:1048] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260807 07:56:45.994098 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:46.005837 30585 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.000204 30869 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:46.019261 30730 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:46.032537 30372 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:46.036012 30585 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:46.037832 30429 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:46.038738 30996 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:46.039319 30996 raft_consensus.cc:697] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:46.040117 30996 consensus_queue.cc:237] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.045603 30653 tablet_bootstrap.cc:654] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.052644 30912 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.065196 30869 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:46.072045 30869 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.074055 30869 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:46.075429 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:46.083630 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:46.084607 30585 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:46.092233 30658 tablet_bootstrap.cc:492] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:46.092720 30658 ts_tablet_manager.cc:1403] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.276s user 0.018s sys 0.038s
I20260807 07:56:46.093413 30912 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:46.094666 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:46.095510 30366 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.097955 30487 raft_consensus.cc:2393] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 1: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:56:46.103890 30320 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:46.103817 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:46.108271 30586 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.134889 30654 tablet_bootstrap.cc:492] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:46.135427 30654 ts_tablet_manager.cc:1403] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.258s user 0.013s sys 0.020s
I20260807 07:56:46.128875 30658 raft_consensus.cc:359] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.136773 30658 raft_consensus.cc:385] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.136965 30658 raft_consensus.cc:740] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.137498 30658 consensus_queue.cc:260] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.139681 30658 ts_tablet_manager.cc:1434] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.047s user 0.006s sys 0.002s
I20260807 07:56:46.145766 30366 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:46.149518 30943 raft_consensus.cc:2764] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 07:56:46.156113 30429 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:46.157140 30998 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:46.157954 30998 raft_consensus.cc:697] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:46.159443 30998 consensus_queue.cc:237] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.167127 30653 tablet_bootstrap.cc:492] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:46.167723 30653 ts_tablet_manager.cc:1403] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.246s user 0.015s sys 0.030s
I20260807 07:56:46.175184 30221 catalog_manager.cc:5697] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:46.183426 30653 raft_consensus.cc:359] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.183794 30942 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:46.184264 30653 raft_consensus.cc:385] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.184996 30658 tablet_bootstrap.cc:492] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:46.184569 30942 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.189499 30942 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:46.196753 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:46.197763 30372 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:46.199322 30429 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:46.200220 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:46.205946 30942 raft_consensus.cc:2804] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:46.206566 30942 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:46.207161 30942 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.211683 30586 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:46.164965 30654 raft_consensus.cc:359] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.218222 30654 raft_consensus.cc:385] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.219364 30654 raft_consensus.cc:740] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.220902 30654 consensus_queue.cc:260] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.228341 30654 ts_tablet_manager.cc:1434] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.090s user 0.008s sys 0.000s
I20260807 07:56:46.184576 30653 raft_consensus.cc:740] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.229815 30653 consensus_queue.cc:260] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.232501 30653 ts_tablet_manager.cc:1434] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.064s user 0.008s sys 0.000s
I20260807 07:56:46.233762 30653 tablet_bootstrap.cc:492] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:46.239872 30654 tablet_bootstrap.cc:492] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e: Bootstrap starting.
W20260807 07:56:46.248430 30294 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260807 07:56:46.250697 30429 leader_election.cc:343] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:46.261086 30658 tablet_bootstrap.cc:654] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.265304 30942 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.267469 30942 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:46.268568 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:46.269219 30372 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.270148 30654 tablet_bootstrap.cc:654] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.271330 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:56:46.274824 30429 leader_election.cc:343] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:46.280623 30372 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:46.285104 30429 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:46.286302 30942 raft_consensus.cc:2804] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:46.286783 30942 raft_consensus.cc:697] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:46.287595 30942 consensus_queue.cc:237] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.298482 30653 tablet_bootstrap.cc:654] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.294673 30998 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:46.299105 30998 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.313239 30654 tablet_bootstrap.cc:492] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:46.313907 30654 ts_tablet_manager.cc:1403] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.074s user 0.009s sys 0.015s
I20260807 07:56:46.318213 30654 raft_consensus.cc:359] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.318897 30654 raft_consensus.cc:385] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.319759 30654 raft_consensus.cc:740] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.320475 30654 consensus_queue.cc:260] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.321079 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:46.322211 30998 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:46.322926 30654 ts_tablet_manager.cc:1434] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260807 07:56:46.324299 30654 tablet_bootstrap.cc:492] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:46.323675 30221 catalog_manager.cc:5697] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:46.324384 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:46.326241 30658 tablet_bootstrap.cc:492] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:46.326797 30658 ts_tablet_manager.cc:1403] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.142s user 0.008s sys 0.017s
I20260807 07:56:46.328001 30221 catalog_manager.cc:5697] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:46.331254 30658 raft_consensus.cc:359] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.331926 30658 raft_consensus.cc:385] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.332201 30658 raft_consensus.cc:740] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.332860 30658 consensus_queue.cc:260] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.340479 30372 raft_consensus.cc:2468] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
W20260807 07:56:46.326403 30429 leader_election.cc:343] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:46.343189 30429 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:46.348773 30941 raft_consensus.cc:2804] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:46.349184 30941 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:46.349557 30941 raft_consensus.cc:3060] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.394009 30590 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.397792 30654 tablet_bootstrap.cc:654] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.398624 30658 ts_tablet_manager.cc:1434] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.071s user 0.018s sys 0.013s
I20260807 07:56:46.403240 30658 tablet_bootstrap.cc:492] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:46.399700 30941 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.409579 30653 tablet_bootstrap.cc:492] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:46.410018 30941 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:46.410040 30653 ts_tablet_manager.cc:1403] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.177s user 0.014s sys 0.013s
I20260807 07:56:46.414016 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:56:46.415657 30429 leader_election.cc:343] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:46.420228 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:46.416985 30653 raft_consensus.cc:359] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.469879 30658 tablet_bootstrap.cc:654] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.470053 30372 raft_consensus.cc:3060] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.477800 30372 raft_consensus.cc:2468] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:46.478566 30653 raft_consensus.cc:385] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.479077 30429 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:46.480865 30998 raft_consensus.cc:2804] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:46.481679 30998 raft_consensus.cc:697] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:46.483222 30998 consensus_queue.cc:237] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.486856 30653 raft_consensus.cc:740] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.491060 30653 consensus_queue.cc:260] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.493775 30658 tablet_bootstrap.cc:492] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:46.493924 30653 ts_tablet_manager.cc:1434] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.083s user 0.007s sys 0.000s
I20260807 07:56:46.494274 30658 ts_tablet_manager.cc:1403] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.091s user 0.027s sys 0.034s
I20260807 07:56:46.495379 30869 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:46.496145 30869 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.497120 30658 raft_consensus.cc:359] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.499646 30658 raft_consensus.cc:385] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.499910 30658 raft_consensus.cc:740] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.500563 30658 consensus_queue.cc:260] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.502146 30658 ts_tablet_manager.cc:1434] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 07:56:46.503312 30658 tablet_bootstrap.cc:492] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:46.504195 30869 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:46.505074 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:46.505898 30490 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:46.507984 30317 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:46.509480 30943 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:46.510219 30943 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:46.510067 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:46.511072 30943 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
W20260807 07:56:46.512312 30320 leader_election.cc:343] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:46.518842 30658 tablet_bootstrap.cc:654] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.528491 30664 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:46.529047 30664 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.532495 30664 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:46.533524 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:46.534327 30372 raft_consensus.cc:2393] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 1: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:56:46.544634 30654 tablet_bootstrap.cc:492] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:46.545149 30654 ts_tablet_manager.cc:1403] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.221s user 0.049s sys 0.111s
I20260807 07:56:46.545501 30658 tablet_bootstrap.cc:492] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:46.545936 30658 ts_tablet_manager.cc:1403] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.043s user 0.021s sys 0.013s
I20260807 07:56:46.547753 30654 raft_consensus.cc:359] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.548447 30654 raft_consensus.cc:385] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.548767 30654 raft_consensus.cc:740] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.548492 30658 raft_consensus.cc:359] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.548852 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:46.549180 30658 raft_consensus.cc:385] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.549508 30658 raft_consensus.cc:740] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.549551 30654 consensus_queue.cc:260] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.551661 30654 ts_tablet_manager.cc:1434] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.006s user 0.002s sys 0.002s
I20260807 07:56:46.551738 30996 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:46.550225 30658 consensus_queue.cc:260] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.554247 30658 ts_tablet_manager.cc:1434] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 07:56:46.555260 30658 tablet_bootstrap.cc:492] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:46.555558 30654 tablet_bootstrap.cc:492] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:46.559791 30539 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:46.560951 30664 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.562961 30658 tablet_bootstrap.cc:654] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.568800 30653 tablet_bootstrap.cc:492] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:46.569878 30654 tablet_bootstrap.cc:654] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.582912 30658 tablet_bootstrap.cc:492] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:46.583334 30658 ts_tablet_manager.cc:1403] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.028s user 0.017s sys 0.007s
I20260807 07:56:46.585220 30658 raft_consensus.cc:359] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.585816 30658 raft_consensus.cc:385] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.586081 30658 raft_consensus.cc:740] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.586846 30658 consensus_queue.cc:260] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.590191 30664 raft_consensus.cc:2749] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:46.595129 30654 tablet_bootstrap.cc:492] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:46.594427 30658 ts_tablet_manager.cc:1434] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.011s user 0.006s sys 0.001s
I20260807 07:56:46.596374 30658 tablet_bootstrap.cc:492] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:46.595723 30654 ts_tablet_manager.cc:1403] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.040s user 0.010s sys 0.017s
I20260807 07:56:46.595147 30943 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.623867 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:46.623917 30220 catalog_manager.cc:5697] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:46.627048 30658 tablet_bootstrap.cc:654] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.627795 30943 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:46.677649 30998 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260807 07:56:46.680431 30912 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 07:56:46.687780 30320 leader_election.cc:343] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:46.691766 30912 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:46.692572 30653 tablet_bootstrap.cc:654] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.695866 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:46.696422 30482 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.696852 30654 raft_consensus.cc:359] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.697528 30654 raft_consensus.cc:385] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.697791 30654 raft_consensus.cc:740] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.698653 30654 consensus_queue.cc:260] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.713095 30482 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:46.725685 30317 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:46.732815 30730 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:46.733336 30730 raft_consensus.cc:697] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:46.734257 30654 ts_tablet_manager.cc:1434] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.135s user 0.017s sys 0.024s
I20260807 07:56:46.734238 30730 consensus_queue.cc:237] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.742831 30654 tablet_bootstrap.cc:492] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:46.749146 30664 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:46.749691 30664 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.759310 30658 tablet_bootstrap.cc:492] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:46.759812 30658 ts_tablet_manager.cc:1403] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.164s user 0.013s sys 0.029s
I20260807 07:56:46.769336 30664 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:46.772125 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:46.772804 30941 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:46.773329 30941 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.775254 30941 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:46.772967 30482 raft_consensus.cc:2393] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 1: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:56:46.777025 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:56:46.782475 30429 leader_election.cc:343] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:46.782342 30221 catalog_manager.cc:5697] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:46.789876 30654 tablet_bootstrap.cc:654] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.805787 30653 tablet_bootstrap.cc:492] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:46.806321 30653 ts_tablet_manager.cc:1403] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.238s user 0.023s sys 0.029s
I20260807 07:56:46.808858 30653 raft_consensus.cc:359] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.810667 30653 raft_consensus.cc:385] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.810993 30653 raft_consensus.cc:740] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.811668 30653 consensus_queue.cc:260] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.815704 30653 ts_tablet_manager.cc:1434] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260807 07:56:46.820681 30658 raft_consensus.cc:359] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.821417 30658 raft_consensus.cc:385] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.822054 30658 raft_consensus.cc:740] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
W20260807 07:56:46.821970 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 69736.1us
I20260807 07:56:46.821266 30941 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:46.825591 30653 tablet_bootstrap.cc:492] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:46.826457 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:46.822784 30658 consensus_queue.cc:260] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.830756 30541 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:46.833434 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:56:46.836421 30429 leader_election.cc:343] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:46.836899 30429 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:46.835290 30749 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.847971 30996 raft_consensus.cc:2749] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:46.854058 30658 ts_tablet_manager.cc:1434] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.094s user 0.008s sys 0.000s
I20260807 07:56:46.855163 30658 tablet_bootstrap.cc:492] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:46.858088 30653 tablet_bootstrap.cc:654] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.879997 30749 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:46.881870 30654 tablet_bootstrap.cc:492] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:46.882367 30654 ts_tablet_manager.cc:1403] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.146s user 0.017s sys 0.007s
W20260807 07:56:46.886251 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 49862.9us
I20260807 07:56:46.893023 30654 raft_consensus.cc:359] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.893718 30654 raft_consensus.cc:385] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.894001 30654 raft_consensus.cc:740] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.895017 30658 tablet_bootstrap.cc:654] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.894841 30654 consensus_queue.cc:260] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.896905 30654 ts_tablet_manager.cc:1434] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260807 07:56:46.901877 30654 tablet_bootstrap.cc:492] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:46.907174 30730 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:46.907732 30730 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.908169 30654 tablet_bootstrap.cc:654] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:46.917466 30730 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:46.918193 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:46.918543 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:46.919180 30590 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
W20260807 07:56:46.919649 30317 leader_election.cc:343] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:46.920516 30320 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:46.923911 30653 tablet_bootstrap.cc:492] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:46.924355 30653 ts_tablet_manager.cc:1403] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.099s user 0.015s sys 0.003s
I20260807 07:56:46.924878 30730 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:46.927618 30730 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:46.927958 30730 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.923231 30941 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:46.931529 30941 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.932173 30653 raft_consensus.cc:359] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.937536 30653 raft_consensus.cc:385] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.937891 30653 raft_consensus.cc:740] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.938606 30653 consensus_queue.cc:260] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.940686 30653 ts_tablet_manager.cc:1434] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.016s user 0.001s sys 0.005s
I20260807 07:56:46.940987 30941 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:46.944588 30730 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.943120 30653 tablet_bootstrap.cc:492] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:46.950839 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:46.952265 30730 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:46.952541 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:46.953190 30590 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.956046 30654 tablet_bootstrap.cc:492] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:46.956525 30654 ts_tablet_manager.cc:1403] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.055s user 0.007s sys 0.008s
I20260807 07:56:46.956851 30653 tablet_bootstrap.cc:654] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
W20260807 07:56:46.961180 30317 leader_election.cc:343] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:46.960884 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:46.963191 31054 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:46.963951 31054 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.965735 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:46.950831 30658 tablet_bootstrap.cc:492] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:46.965873 30590 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
W20260807 07:56:46.966487 30429 leader_election.cc:343] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:46.968755 30320 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:46.968648 30654 raft_consensus.cc:359] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.969304 30654 raft_consensus.cc:385] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.969597 30654 raft_consensus.cc:740] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:46.969900 30869 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:46.970423 30869 raft_consensus.cc:697] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:46.971355 30869 consensus_queue.cc:237] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.972177 30585 raft_consensus.cc:3060] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:46.976287 30654 consensus_queue.cc:260] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.966579 30658 ts_tablet_manager.cc:1403] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.112s user 0.006s sys 0.008s
I20260807 07:56:46.977970 30654 ts_tablet_manager.cc:1434] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.021s user 0.007s sys 0.000s
I20260807 07:56:46.979117 30654 tablet_bootstrap.cc:492] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:46.982868 31054 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:46.983718 31054 consensus_queue.cc:1048] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260807 07:56:46.985267 30429 leader_election.cc:343] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:46.987483 30429 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:46.989032 30997 raft_consensus.cc:2749] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:46.990279 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:46.999073 30658 raft_consensus.cc:359] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:46.999716 30658 raft_consensus.cc:385] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:46.999996 30658 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.000695 30658 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.009438 30996 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:47.013361 30482 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.024536 30664 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:47.025048 30664 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.030179 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:47.032681 30941 consensus_queue.cc:1048] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:47.035830 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:47.040966 30997 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:47.041975 30539 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:47.041719 30997 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.037889 31054 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:47.042838 30749 raft_consensus.cc:2749] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:56:47.038550 30664 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:47.048681 30658 ts_tablet_manager.cc:1434] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.071s user 0.006s sys 0.005s
I20260807 07:56:47.043064 31054 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.016067 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:47.055397 31054 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:47.062758 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:47.063257 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:56:47.064883 30429 leader_election.cc:343] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
W20260807 07:56:47.065636 30429 leader_election.cc:343] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:47.065992 30429 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:47.067114 30429 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:47.067445 30220 catalog_manager.cc:5697] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:47.068176 31054 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:47.069964 30658 tablet_bootstrap.cc:492] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:47.101429 30997 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:47.107101 30653 tablet_bootstrap.cc:492] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:47.107213 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:47.107690 30653 ts_tablet_manager.cc:1403] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.165s user 0.036s sys 0.032s
W20260807 07:56:47.108546 30429 leader_election.cc:343] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:47.122486 30654 tablet_bootstrap.cc:654] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.127394 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:47.176949 30658 tablet_bootstrap.cc:654] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.186956 30653 raft_consensus.cc:359] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.187882 30653 raft_consensus.cc:385] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.188225 30653 raft_consensus.cc:740] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.189966 30653 consensus_queue.cc:260] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.195838 31054 raft_consensus.cc:2749] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:47.198496 30653 ts_tablet_manager.cc:1434] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.091s user 0.005s sys 0.004s
I20260807 07:56:47.199873 30653 tablet_bootstrap.cc:492] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:47.209498 30730 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260807 07:56:47.206944 30366 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:47.236204 30653 tablet_bootstrap.cc:654] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.240351 30429 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:47.244024 31055 raft_consensus.cc:2804] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:47.246618 31055 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:47.254976 31055 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.286082 30654 tablet_bootstrap.cc:492] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:47.286711 30654 ts_tablet_manager.cc:1403] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.308s user 0.025s sys 0.033s
I20260807 07:56:47.289369 30654 raft_consensus.cc:359] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.290530 30654 raft_consensus.cc:385] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.290870 30654 raft_consensus.cc:740] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.291540 30654 consensus_queue.cc:260] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.293051 30654 ts_tablet_manager.cc:1434] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260807 07:56:47.293113 30658 tablet_bootstrap.cc:492] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:47.303962 30658 ts_tablet_manager.cc:1403] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.234s user 0.021s sys 0.034s
I20260807 07:56:47.307241 30658 raft_consensus.cc:359] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.308018 30658 raft_consensus.cc:385] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.308348 30658 raft_consensus.cc:740] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.309288 30658 consensus_queue.cc:260] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.310819 30788 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:47.311662 30658 ts_tablet_manager.cc:1434] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260807 07:56:47.313226 31055 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:56:47.315137 30294 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:56:47.319435 30654 tablet_bootstrap.cc:492] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:47.316764 30658 tablet_bootstrap.cc:492] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:47.329646 30653 tablet_bootstrap.cc:492] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:47.330178 30653 ts_tablet_manager.cc:1403] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.131s user 0.008s sys 0.010s
I20260807 07:56:47.371803 30653 raft_consensus.cc:359] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.372501 30653 raft_consensus.cc:385] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.372830 30653 raft_consensus.cc:740] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.374922 30654 tablet_bootstrap.cc:654] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.381055 30653 consensus_queue.cc:260] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.389125 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:47.390223 30369 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.397423 30943 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:47.398192 30943 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.404094 30943 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:47.406105 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:47.417409 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:56:47.418907 30320 leader_election.cc:343] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:47.419643 31055 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:47.414218 30369 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:47.421245 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:56:47.422688 30317 leader_election.cc:343] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
W20260807 07:56:47.423051 30429 leader_election.cc:343] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:47.425151 30317 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:47.427209 30943 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:47.474251 30658 tablet_bootstrap.cc:654] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.476939 30653 ts_tablet_manager.cc:1434] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.146s user 0.010s sys 0.000s
I20260807 07:56:47.477849 30653 tablet_bootstrap.cc:492] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:47.474009 30429 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:47.479982 30942 raft_consensus.cc:2804] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:47.480580 30942 raft_consensus.cc:697] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:47.481559 30749 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:47.482120 30749 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.482728 30942 consensus_queue.cc:237] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.484594 30749 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:47.485481 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:47.486136 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:47.486244 30373 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:47.486716 30490 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:47.487675 30541 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:47.488413 30749 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:47.488775 30749 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:47.489154 30749 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.495859 30749 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.504233 30749 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:47.506021 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:47.506889 30369 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.512259 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:47.516881 30482 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.519390 30653 tablet_bootstrap.cc:654] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.519639 30788 consensus_queue.cc:1048] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:47.521703 30654 tablet_bootstrap.cc:492] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:47.522254 30654 ts_tablet_manager.cc:1403] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.203s user 0.007s sys 0.013s
I20260807 07:56:47.522552 30369 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:47.523962 30541 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:47.524962 31080 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:47.525548 31080 raft_consensus.cc:697] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:47.526044 30222 catalog_manager.cc:5697] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:47.526764 31080 consensus_queue.cc:237] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.528919 30654 raft_consensus.cc:359] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:56:47.532310 30317 consensus_peers.cc:597] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 -> Peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Couldn't send request to peer ef1ca7acf52a438f89f14707e9e06818. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:47.532930 30654 raft_consensus.cc:385] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.533308 30654 raft_consensus.cc:740] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.534067 30654 consensus_queue.cc:260] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.537209 30654 ts_tablet_manager.cc:1434] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20260807 07:56:47.537628 30658 tablet_bootstrap.cc:492] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:47.538359 30654 tablet_bootstrap.cc:492] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:47.543617 30658 ts_tablet_manager.cc:1403] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.231s user 0.012s sys 0.034s
I20260807 07:56:47.539728 30482 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:47.552188 30654 tablet_bootstrap.cc:654] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.557837 30653 tablet_bootstrap.cc:492] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:47.558382 30653 ts_tablet_manager.cc:1403] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.081s user 0.009s sys 0.008s
I20260807 07:56:47.558688 30658 raft_consensus.cc:359] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.559357 30658 raft_consensus.cc:385] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.559608 30658 raft_consensus.cc:740] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.560218 30658 consensus_queue.cc:260] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.562217 30658 ts_tablet_manager.cc:1434] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.018s user 0.005s sys 0.001s
I20260807 07:56:47.563732 30222 catalog_manager.cc:5697] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:47.578450 30653 raft_consensus.cc:359] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.579326 30653 raft_consensus.cc:385] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.579674 30653 raft_consensus.cc:740] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.580652 30653 consensus_queue.cc:260] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.583088 30653 ts_tablet_manager.cc:1434] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20260807 07:56:47.587049 30653 tablet_bootstrap.cc:492] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:47.599805 30653 tablet_bootstrap.cc:654] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.614197 30653 tablet_bootstrap.cc:492] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:47.614773 30653 ts_tablet_manager.cc:1403] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.016s
I20260807 07:56:47.616448 30658 tablet_bootstrap.cc:492] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:47.617902 30653 raft_consensus.cc:359] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.618772 30653 raft_consensus.cc:385] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.619091 30653 raft_consensus.cc:740] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.619946 30653 consensus_queue.cc:260] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.622303 30653 ts_tablet_manager.cc:1434] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260807 07:56:47.626304 30658 tablet_bootstrap.cc:654] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.627871 30653 tablet_bootstrap.cc:492] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:47.629335 30654 tablet_bootstrap.cc:492] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:47.630685 30654 ts_tablet_manager.cc:1403] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.093s user 0.028s sys 0.041s
I20260807 07:56:47.633653 30654 raft_consensus.cc:359] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.635471 30654 raft_consensus.cc:385] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.635802 30654 raft_consensus.cc:740] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.638051 30654 consensus_queue.cc:260] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.640281 30654 ts_tablet_manager.cc:1434] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260807 07:56:47.641005 30658 tablet_bootstrap.cc:492] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:47.641571 30658 ts_tablet_manager.cc:1403] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.025s user 0.016s sys 0.000s
I20260807 07:56:47.641803 30654 tablet_bootstrap.cc:492] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:47.651232 30653 tablet_bootstrap.cc:654] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.652712 30654 tablet_bootstrap.cc:654] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.655009 30658 raft_consensus.cc:359] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.655789 30658 raft_consensus.cc:385] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.656108 30658 raft_consensus.cc:740] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.661056 31080 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:47.661799 31080 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.663590 30658 consensus_queue.cc:260] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.665652 31080 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:47.666230 30658 ts_tablet_manager.cc:1434] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.024s user 0.006s sys 0.001s
I20260807 07:56:47.667423 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:47.667943 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:47.668424 30482 raft_consensus.cc:2468] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:47.668893 30369 raft_consensus.cc:2468] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:47.672350 30541 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:47.674556 31051 raft_consensus.cc:2804] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:47.674892 31051 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:47.675186 31051 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.678699 30658 tablet_bootstrap.cc:492] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:47.703099 31051 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.707263 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:47.708004 30373 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.709439 30653 tablet_bootstrap.cc:492] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:47.709807 30653 ts_tablet_manager.cc:1403] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.082s user 0.012s sys 0.024s
I20260807 07:56:47.711694 30749 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:47.712142 30749 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.713505 30653 raft_consensus.cc:359] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.714207 30653 raft_consensus.cc:385] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.714520 30653 raft_consensus.cc:740] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.715176 31051 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:47.715754 31055 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:47.717199 30654 tablet_bootstrap.cc:492] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:47.718568 30654 ts_tablet_manager.cc:1403] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.077s user 0.016s sys 0.015s
I20260807 07:56:47.718233 31055 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.718837 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:47.717623 30653 consensus_queue.cc:260] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.719750 30369 raft_consensus.cc:2393] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 1: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:56:47.714102 30749 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:47.744078 30653 ts_tablet_manager.cc:1434] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.034s user 0.007s sys 0.008s
I20260807 07:56:47.745553 31055 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:47.745298 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:47.746809 31051 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:47.747721 30367 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:47.747575 30654 raft_consensus.cc:359] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.748268 30654 raft_consensus.cc:385] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.748530 30654 raft_consensus.cc:740] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.749171 30654 consensus_queue.cc:260] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.749915 30429 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:47.747443 31051 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.751222 30654 ts_tablet_manager.cc:1434] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
I20260807 07:56:47.753980 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:47.756085 30654 tablet_bootstrap.cc:492] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:47.753610 30653 tablet_bootstrap.cc:492] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
W20260807 07:56:47.757656 30429 leader_election.cc:343] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:47.766083 30996 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:47.745678 30373 raft_consensus.cc:2468] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:47.766698 30996 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.769315 30996 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:47.771049 30658 tablet_bootstrap.cc:654] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.774471 30541 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:47.775460 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:47.777501 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:47.761822 31055 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:47.779325 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:47.779765 30490 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.780979 31080 raft_consensus.cc:2804] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:47.781229 31055 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:47.781808 31055 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.786926 30490 raft_consensus.cc:2468] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:47.781116 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:56:47.785521 30429 leader_election.cc:343] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:47.789554 30539 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:56:47.790933 30429 leader_election.cc:343] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:47.792712 30749 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.792932 30429 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:47.797011 31080 raft_consensus.cc:697] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:47.799844 31080 consensus_queue.cc:237] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.801941 31055 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.794004 31054 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:47.805611 31051 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:47.807785 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:47.809695 31051 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:56:47.810151 30539 leader_election.cc:343] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:47.810484 30749 raft_consensus.cc:2749] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:47.805613 31055 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:47.815207 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:47.815371 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:47.815897 30369 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:47.816116 30373 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.818372 30541 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:47.819036 30664 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:47.819365 30664 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:47.819650 30664 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.820003 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:56:47.824210 30429 leader_election.cc:343] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:47.831837 30664 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.833427 30664 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:47.813405 31051 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.834453 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:47.834977 30369 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.836632 30658 tablet_bootstrap.cc:492] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:47.837150 30658 ts_tablet_manager.cc:1403] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.159s user 0.013s sys 0.015s
I20260807 07:56:47.839871 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:47.841105 30369 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:47.842195 30541 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:56:47.845818 30539 leader_election.cc:343] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:47.847505 30654 tablet_bootstrap.cc:654] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.850106 30373 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:47.848968 31102 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:47.856943 30429 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:47.857023 31102 raft_consensus.cc:697] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:47.859475 30942 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:47.860138 30942 raft_consensus.cc:697] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:47.863075 31051 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:47.862599 30942 consensus_queue.cc:237] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.867676 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:47.868234 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:47.868561 30373 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:47.859344 31102 consensus_queue.cc:237] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:56:47.872994 30539 leader_election.cc:343] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:47.873876 30541 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:47.875856 31080 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:47.876569 31080 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:47.876547 30222 catalog_manager.cc:5697] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:47.877761 31080 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.881644 30658 raft_consensus.cc:359] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.882318 30658 raft_consensus.cc:385] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.882583 30658 raft_consensus.cc:740] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.886729 30658 consensus_queue.cc:260] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.894346 30658 ts_tablet_manager.cc:1434] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.057s user 0.002s sys 0.008s
I20260807 07:56:47.902280 30658 tablet_bootstrap.cc:492] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:47.915642 30653 tablet_bootstrap.cc:654] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.929098 30942 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:47.930986 30942 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.932986 30221 catalog_manager.cc:5697] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:47.943746 30654 tablet_bootstrap.cc:492] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:47.944159 30654 ts_tablet_manager.cc:1403] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.188s user 0.013s sys 0.016s
I20260807 07:56:47.941653 30942 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:47.948405 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:47.951328 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:47.955672 31080 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.955627 30222 catalog_manager.cc:5697] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:47.957316 30653 tablet_bootstrap.cc:492] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:47.960834 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:47.957523 30429 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:47.962328 31054 raft_consensus.cc:2749] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 07:56:47.962730 30539 leader_election.cc:343] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:47.965334 30654 raft_consensus.cc:359] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.965938 30654 raft_consensus.cc:385] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.966207 30654 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.966878 30654 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.968734 30654 ts_tablet_manager.cc:1434] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.024s user 0.000s sys 0.004s
I20260807 07:56:47.958635 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:47.959467 31080 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:47.959599 30658 tablet_bootstrap.cc:654] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.961484 30653 ts_tablet_manager.cc:1403] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.209s user 0.013s sys 0.010s
I20260807 07:56:47.969655 30654 tablet_bootstrap.cc:492] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:47.969650 30373 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:47.984745 30654 tablet_bootstrap.cc:654] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:47.985106 30373 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:47.986912 30653 raft_consensus.cc:359] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.988611 30653 raft_consensus.cc:385] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:47.988998 30541 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:47.989876 31080 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:47.988926 30653 raft_consensus.cc:740] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:47.990612 31080 raft_consensus.cc:697] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:47.990868 30653 consensus_queue.cc:260] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.992537 30658 tablet_bootstrap.cc:492] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:47.991932 31080 consensus_queue.cc:237] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:47.993065 30658 ts_tablet_manager.cc:1403] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.091s user 0.009s sys 0.009s
I20260807 07:56:47.996843 30653 ts_tablet_manager.cc:1434] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.027s user 0.008s sys 0.000s
I20260807 07:56:47.997833 30653 tablet_bootstrap.cc:492] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:47.998064 30654 tablet_bootstrap.cc:492] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:47.998525 30654 ts_tablet_manager.cc:1403] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.029s user 0.008s sys 0.014s
I20260807 07:56:48.000474 30658 raft_consensus.cc:359] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.002085 30658 raft_consensus.cc:385] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:48.002743 30658 raft_consensus.cc:740] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:48.004347 30658 consensus_queue.cc:260] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.004262 30654 raft_consensus.cc:359] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.007989 30654 raft_consensus.cc:385] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:48.008311 30654 raft_consensus.cc:740] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:48.009017 30654 consensus_queue.cc:260] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.009034 30658 ts_tablet_manager.cc:1434] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.016s user 0.008s sys 0.000s
I20260807 07:56:48.012115 30654 ts_tablet_manager.cc:1434] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.013s user 0.005s sys 0.004s
I20260807 07:56:48.013170 30658 tablet_bootstrap.cc:492] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:48.013164 30654 tablet_bootstrap.cc:492] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:48.022657 30869 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:48.023252 30869 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.027392 30653 tablet_bootstrap.cc:654] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:48.027894 31054 consensus_queue.cc:1048] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:48.029498 30869 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:48.031203 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:48.036087 30654 tablet_bootstrap.cc:654] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
W20260807 07:56:48.036186 30317 leader_election.cc:343] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:48.032975 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:56:48.040040 30320 leader_election.cc:343] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:48.040485 30320 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:48.041234 30788 raft_consensus.cc:2749] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:48.044212 30653 tablet_bootstrap.cc:492] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:48.034377 30658 tablet_bootstrap.cc:654] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:48.044678 30653 ts_tablet_manager.cc:1403] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.047s user 0.012s sys 0.002s
I20260807 07:56:48.048269 30654 tablet_bootstrap.cc:492] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:48.048790 30654 ts_tablet_manager.cc:1403] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.036s user 0.012s sys 0.000s
I20260807 07:56:48.051590 30222 catalog_manager.cc:5697] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:48.052739 30654 raft_consensus.cc:359] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.055244 30654 raft_consensus.cc:385] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:48.055531 30654 raft_consensus.cc:740] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:48.056267 30653 raft_consensus.cc:359] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.057121 30653 raft_consensus.cc:385] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:48.057480 30653 raft_consensus.cc:740] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:48.056273 30654 consensus_queue.cc:260] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.058189 30653 consensus_queue.cc:260] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.080054 30654 ts_tablet_manager.cc:1434] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.031s user 0.004s sys 0.004s
I20260807 07:56:48.081684 30654 tablet_bootstrap.cc:492] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:48.084542 30653 ts_tablet_manager.cc:1434] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.040s user 0.003s sys 0.010s
I20260807 07:56:48.091614 30653 tablet_bootstrap.cc:492] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:48.106990 30658 tablet_bootstrap.cc:492] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:48.107671 30658 ts_tablet_manager.cc:1403] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.095s user 0.020s sys 0.024s
I20260807 07:56:48.109267 30653 tablet_bootstrap.cc:654] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:48.109916 30654 tablet_bootstrap.cc:654] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:48.118439 31080 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:48.119838 30658 raft_consensus.cc:359] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.120604 30658 raft_consensus.cc:385] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:48.120915 30658 raft_consensus.cc:740] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:48.128780 30482 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:48.131510 30658 consensus_queue.cc:260] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.133534 31102 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:48.134248 30658 ts_tablet_manager.cc:1434] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.026s user 0.005s sys 0.001s
I20260807 07:56:48.134720 30653 tablet_bootstrap.cc:492] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:48.112218 31054 consensus_queue.cc:1048] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260807 07:56:48.135462 30658 tablet_bootstrap.cc:492] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:48.140487 30653 ts_tablet_manager.cc:1403] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.053s user 0.023s sys 0.000s
I20260807 07:56:48.154543 30654 tablet_bootstrap.cc:492] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:48.155580 30654 ts_tablet_manager.cc:1403] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.074s user 0.010s sys 0.021s
I20260807 07:56:48.156082 30653 raft_consensus.cc:359] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.160874 30653 raft_consensus.cc:385] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:48.161650 30653 raft_consensus.cc:740] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:48.163057 30653 consensus_queue.cc:260] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.167760 30654 raft_consensus.cc:359] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.168562 30654 raft_consensus.cc:385] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:48.168841 30654 raft_consensus.cc:740] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:48.169581 30654 consensus_queue.cc:260] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.171748 30654 ts_tablet_manager.cc:1434] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.015s user 0.003s sys 0.003s
I20260807 07:56:48.173583 30654 tablet_bootstrap.cc:492] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:48.183525 30653 ts_tablet_manager.cc:1434] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.042s user 0.004s sys 0.006s
I20260807 07:56:48.206012 30653 tablet_bootstrap.cc:492] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:48.215837 31080 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:48.216610 31080 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.221418 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:56:48.224771 30541 leader_election.cc:343] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
W20260807 07:56:48.276559 31126 log.cc:927] Time spent T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.061s user 0.007s sys 0.006s
I20260807 07:56:48.277597 30749 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:48.282523 30749 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.284327 30749 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:48.286494 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:48.287093 30490 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:48.288188 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:48.288543 30539 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:48.288780 30490 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:48.289338 31101 raft_consensus.cc:2804] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:48.290166 30539 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:56:48.290786 30749 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:48.289731 31101 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:48.291143 30749 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:48.291467 31101 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:48.291493 30749 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:48.301245 30749 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.303136 30654 tablet_bootstrap.cc:654] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:48.285629 31080 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:48.305337 31102 consensus_queue.cc:1048] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:48.306414 30658 tablet_bootstrap.cc:654] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:48.310019 30749 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:48.324925 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:48.325608 30490 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:48.331125 30490 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:48.332260 30539 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:48.333853 30664 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:48.334327 30664 raft_consensus.cc:697] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:48.335093 30664 consensus_queue.cc:237] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.341092 30653 tablet_bootstrap.cc:654] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:48.370838 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:48.371507 30372 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:48.378924 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:48.379900 30996 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:48.380658 30996 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.370743 30998 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:48.391408 30998 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:56:48.413986 31118 log.cc:927] Time spent T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.097s user 0.000s sys 0.001s
I20260807 07:56:48.406006 30996 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:48.434633 30654 tablet_bootstrap.cc:492] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:48.435138 30654 ts_tablet_manager.cc:1403] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.262s user 0.016s sys 0.015s
W20260807 07:56:48.438881 30541 leader_election.cc:343] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:48.440400 30664 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 07:56:48.442191 30294 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:56:48.445766 31134 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:48.446623 31134 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.452595 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:48.421660 30998 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:48.474610 30749 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:48.475148 30749 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.444442 31080 consensus_queue.cc:1048] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260807 07:56:48.421339 31101 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.479893 30490 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:48.481315 30749 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:48.478451 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:48.506356 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:48.515192 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:48.540132 30654 raft_consensus.cc:359] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.540968 30654 raft_consensus.cc:385] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:48.541257 30654 raft_consensus.cc:740] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:48.542023 30590 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:48.545426 31101 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:48.551141 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:48.551708 30490 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:48.554584 30749 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:48.557158 30366 raft_consensus.cc:2393] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 1: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:56:48.560285 30654 consensus_queue.cc:260] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.557081 31150 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:48.571511 31150 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.574885 30490 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:48.581215 30539 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:48.581902 30749 raft_consensus.cc:2804] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:48.582371 30749 raft_consensus.cc:697] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:48.571408 30489 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
W20260807 07:56:48.571395 31145 log.cc:927] Time spent T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.073s user 0.000s sys 0.001s
I20260807 07:56:48.583125 30749 consensus_queue.cc:237] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.592176 30658 tablet_bootstrap.cc:492] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:48.592803 30658 ts_tablet_manager.cc:1403] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.458s user 0.028s sys 0.033s
I20260807 07:56:48.615368 30658 raft_consensus.cc:359] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.615780 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:48.616130 30658 raft_consensus.cc:385] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:48.616436 30658 raft_consensus.cc:740] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:48.617054 30658 consensus_queue.cc:260] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.620354 30541 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:48.622311 30664 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:48.624013 30654 ts_tablet_manager.cc:1434] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.189s user 0.009s sys 0.007s
I20260807 07:56:48.626359 30658 ts_tablet_manager.cc:1434] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.033s user 0.008s sys 0.000s
I20260807 07:56:48.592422 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:48.623749 31051 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260807 07:56:48.635536 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:48.711756 30664 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:48.712301 30664 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.701097 30654 tablet_bootstrap.cc:492] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:48.705919 30373 raft_consensus.cc:2393] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:56:48.732892 30664 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:48.736610 30664 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:48.737151 30664 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.752002 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:48.753301 31150 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:48.754426 30664 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:48.757978 30653 tablet_bootstrap.cc:492] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:48.758510 30653 ts_tablet_manager.cc:1403] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.553s user 0.025s sys 0.029s
I20260807 07:56:48.760815 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:48.761869 30478 raft_consensus.cc:2468] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
W20260807 07:56:48.765897 30317 leader_election.cc:343] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:48.771646 30539 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:48.775134 30749 raft_consensus.cc:2804] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:48.775489 30749 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:48.775832 30749 raft_consensus.cc:3060] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:48.782157 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:48.754261 31149 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.208s
I20260807 07:56:48.825798 30749 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.883888 30749 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:48.905685 31149 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:48.906116 31134 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:48.913034 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:48.913677 30369 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:48.914103 30429 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:48.914467 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:48.893077 30653 raft_consensus.cc:359] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.917860 30653 raft_consensus.cc:385] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:48.918143 30653 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:48.918915 30653 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:48.920616 30429 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
W20260807 07:56:48.924332 30429 leader_election.cc:343] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:48.922847 30998 raft_consensus.cc:2749] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:48.975654 30654 tablet_bootstrap.cc:654] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
W20260807 07:56:48.978657 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 83451.4us
I20260807 07:56:48.986737 30653 ts_tablet_manager.cc:1434] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.228s user 0.013s sys 0.000s
I20260807 07:56:49.023991 30369 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:49.036859 30653 tablet_bootstrap.cc:492] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:49.037528 31135 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:49.061618 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:49.065357 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:56:49.089651 30320 leader_election.cc:343] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:49.090188 30320 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:49.097874 30369 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:49.101073 31132 raft_consensus.cc:2749] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:49.101763 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:49.102509 30590 raft_consensus.cc:2393] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:56:49.105131 30653 tablet_bootstrap.cc:654] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:49.097064 30221 catalog_manager.cc:5697] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:49.108712 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:56:49.124626 30539 leader_election.cc:343] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:49.131955 30654 tablet_bootstrap.cc:492] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:49.132726 30654 ts_tablet_manager.cc:1403] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.492s user 0.026s sys 0.011s
I20260807 07:56:49.134400 30658 tablet_bootstrap.cc:492] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
W20260807 07:56:49.137950 30541 leader_election.cc:343] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:49.140995 31169 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260807 07:56:49.185745 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 45683.3us
I20260807 07:56:49.206070 30429 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
W20260807 07:56:49.209717 30541 leader_election.cc:343] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:49.210229 30541 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:49.210886 30664 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 07:56:49.211918 30541 leader_election.cc:343] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:49.194355 31054 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:49.213515 30997 raft_consensus.cc:3060] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:49.253132 30654 raft_consensus.cc:359] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:49.253751 30654 raft_consensus.cc:385] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:49.253971 30654 raft_consensus.cc:740] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:49.217532 31080 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
W20260807 07:56:49.269934 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 57049.7us
I20260807 07:56:49.269240 30654 consensus_queue.cc:260] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:56:49.271327 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 60882.7us
I20260807 07:56:49.232100 31054 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:49.288935 30654 ts_tablet_manager.cc:1434] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.156s user 0.007s sys 0.000s
I20260807 07:56:49.279589 31051 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:49.304224 30997 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260807 07:56:49.314707 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 95110.3us
I20260807 07:56:49.318568 31054 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:49.319223 31132 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:56:49.319852 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 110673us
I20260807 07:56:49.303143 31051 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:49.323207 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:49.319865 31132 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:49.335424 30658 tablet_bootstrap.cc:654] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
W20260807 07:56:49.349231 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 63029.7us
I20260807 07:56:49.419924 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:49.421177 30366 raft_consensus.cc:2468] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
W20260807 07:56:49.425633 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 77853.8us
I20260807 07:56:49.348678 31080 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.071s
W20260807 07:56:49.442335 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 72938.4us
I20260807 07:56:49.490291 31051 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:49.472662 31182 consensus_queue.cc:1048] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.063s
W20260807 07:56:49.614377 31167 log.cc:927] Time spent T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.309s user 0.000s sys 0.005s
I20260807 07:56:49.628463 31132 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:49.651340 30654 tablet_bootstrap.cc:492] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e: Bootstrap starting.
W20260807 07:56:49.647169 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 231167us
W20260807 07:56:49.654183 30294 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:56:49.705600 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:49.735882 30360 raft_consensus.cc:2468] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
W20260807 07:56:49.744503 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 302505us
I20260807 07:56:49.760639 30479 raft_consensus.cc:2468] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:49.771958 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:56:49.783923 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 340910us
I20260807 07:56:49.789309 30541 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:49.787297 30489 raft_consensus.cc:2468] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:49.792891 31101 consensus_queue.cc:1048] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260807 07:56:49.827543 30429 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:49.826294 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:56:49.834924 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 45696.7us
I20260807 07:56:49.835070 30664 raft_consensus.cc:2804] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:49.836349 30664 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:49.836678 30664 raft_consensus.cc:3060] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:49.835389 30539 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:56:49.846410 31202 raft_consensus.cc:2804] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:49.846928 31202 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:49.847321 31202 raft_consensus.cc:3060] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
W20260807 07:56:49.821852 31205 log.cc:927] Time spent T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.063s user 0.000s sys 0.002s
I20260807 07:56:49.867290 30664 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:49.889407 31184 raft_consensus.cc:2804] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:49.977555 30653 tablet_bootstrap.cc:492] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:49.981294 30653 ts_tablet_manager.cc:1403] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.945s user 0.018s sys 0.031s
I20260807 07:56:49.997660 30664 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:49.952989 31182 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:49.917734 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:50.016036 31184 raft_consensus.cc:697] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:50.037660 31184 consensus_queue.cc:237] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.038450 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:50.038827 30584 raft_consensus.cc:2393] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:56:50.044991 31165 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:50.047153 31165 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.049865 31165 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:50.067832 30654 tablet_bootstrap.cc:654] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:50.067932 30653 raft_consensus.cc:359] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.068681 30653 raft_consensus.cc:385] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:50.068957 30653 raft_consensus.cc:740] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.035184 31182 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.070116 31165 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:50.078929 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:50.081204 30653 consensus_queue.cc:260] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.076953 31165 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.090579 30653 ts_tablet_manager.cc:1434] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.109s user 0.006s sys 0.000s
I20260807 07:56:50.091624 30653 tablet_bootstrap.cc:492] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:50.094915 30658 tablet_bootstrap.cc:492] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:50.095400 30658 ts_tablet_manager.cc:1403] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.961s user 0.028s sys 0.067s
I20260807 07:56:50.082826 31202 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.096455 30478 raft_consensus.cc:2393] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 1: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:56:50.084458 31182 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:50.101284 31165 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:50.102113 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:50.104853 31202 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:50.107549 30658 raft_consensus.cc:359] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.108191 30658 raft_consensus.cc:385] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:50.108424 30658 raft_consensus.cc:740] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.109146 30658 consensus_queue.cc:260] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.117512 30653 tablet_bootstrap.cc:654] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:50.126242 30221 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53660 (request call id 118) took 1657 ms. Trace:
I20260807 07:56:50.129127 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:50.142422 30365 raft_consensus.cc:3060] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:50.149648 31164 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:50.150202 31164 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.126804 30221 rpcz_store.cc:276] 0807 07:56:48.468526 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:56:48.468653 (+ 127us) service_pool.cc:224] Handling call
0807 07:56:50.126154 (+1657501us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:56:49.140767 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:56:49.184133 (+ 43366us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:56:49.184178 (+ 45us) write_op.cc:435] Acquired schema lock
0807 07:56:49.184195 (+ 17us) tablet.cc:662] Decoding operations
0807 07:56:49.184610 (+ 415us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:56:49.184693 (+ 83us) write_op.cc:641] Partition lock acquired for write op
0807 07:56:49.184730 (+ 37us) tablet.cc:685] Acquiring locks for 1 operations
0807 07:56:49.184962 (+ 232us) tablet.cc:701] Row locks acquired
0807 07:56:49.184980 (+ 18us) write_op.cc:260] PREPARE: finished
0807 07:56:49.185235 (+ 255us) write_op.cc:270] Start()
0807 07:56:49.185358 (+ 123us) write_op.cc:276] Timestamp: P: 1786089409185179 usec, L: 0
0807 07:56:49.185413 (+ 55us) op_driver.cc:348] REPLICATION: starting
0807 07:56:49.195297 (+ 9884us) log.cc:844] Serialized 540 byte log entry
0807 07:56:49.695413 (+500116us) op_driver.cc:464] REPLICATION: finished
0807 07:56:50.034557 (+339144us) write_op.cc:301] APPLY: starting
0807 07:56:50.034663 (+ 106us) tablet.cc:1367] starting BulkCheckPresence
0807 07:56:50.034767 (+ 104us) tablet.cc:1370] finished BulkCheckPresence
0807 07:56:50.035853 (+ 1086us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:56:50.036418 (+ 565us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:56:50.036571 (+ 153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 07:56:50.036624 (+ 53us) write_op.cc:312] APPLY: finished
0807 07:56:50.036834 (+ 210us) log.cc:844] Serialized 22 byte log entry
0807 07:56:50.036991 (+ 157us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:56:50.037071 (+ 80us) write_op.cc:454] Released schema lock
0807 07:56:50.037110 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0807 07:56:50.037478 (+ 368us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:56:50.037504 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":338030,"apply.run_cpu_time_us":1891,"apply.run_wall_time_us":2895,"num_ops":1,"prepare.queue_time_us":31720,"prepare.run_cpu_time_us":23416,"prepare.run_wall_time_us":112336,"raft.queue_time_us":398733,"raft.run_cpu_time_us":27858,"raft.run_wall_time_us":103800,"replication_time_us":509702,"thread_start_us":265877,"threads_started":4,"wal-append.queue_time_us":67834}]]}
I20260807 07:56:50.152396 31164 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:50.156770 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:50.157563 30588 raft_consensus.cc:2393] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:56:50.159277 30222 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53640 (request call id 107) took 1530 ms. Trace:
I20260807 07:56:50.159636 30222 rpcz_store.cc:276] 0807 07:56:48.629005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:56:48.629168 (+ 163us) service_pool.cc:224] Handling call
0807 07:56:50.159220 (+1530052us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176025,"reported_tablets":3}
I20260807 07:56:50.162675 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:50.165876 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:50.168169 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:56:50.171481 30317 leader_election.cc:343] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:50.174335 30658 ts_tablet_manager.cc:1434] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.079s user 0.004s sys 0.005s
I20260807 07:56:50.179414 30658 tablet_bootstrap.cc:492] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:50.193949 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:50.200780 30654 tablet_bootstrap.cc:492] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:50.201395 30654 ts_tablet_manager.cc:1403] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.565s user 0.026s sys 0.024s
I20260807 07:56:50.208033 30365 raft_consensus.cc:2468] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:50.227169 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:50.251688 30429 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:50.256460 30653 tablet_bootstrap.cc:492] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:50.256984 30653 ts_tablet_manager.cc:1403] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.166s user 0.023s sys 0.011s
I20260807 07:56:50.247028 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:50.269727 30997 raft_consensus.cc:2804] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:50.247962 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:50.271152 30653 raft_consensus.cc:359] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.274115 30653 raft_consensus.cc:385] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:50.274439 30653 raft_consensus.cc:740] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.278805 30541 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:50.279915 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:50.280797 31101 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:56:50.282747 30654 raft_consensus.cc:359] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.283450 30654 raft_consensus.cc:385] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:50.283738 30654 raft_consensus.cc:740] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.288043 30373 raft_consensus.cc:2393] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 1: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:56:50.285514 30997 raft_consensus.cc:697] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:50.295718 30997 consensus_queue.cc:237] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.290644 30653 consensus_queue.cc:260] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.302994 30654 consensus_queue.cc:260] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.329025 30653 ts_tablet_manager.cc:1434] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.072s user 0.004s sys 0.006s
W20260807 07:56:50.327525 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 50551.9us
I20260807 07:56:50.331871 30320 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:50.332624 31164 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:56:50.342432 30320 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:50.342723 30658 tablet_bootstrap.cc:654] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
W20260807 07:56:50.346086 30320 leader_election.cc:343] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:50.346529 30320 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:50.350310 31165 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:50.348173 31151 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:56:50.351477 30653 tablet_bootstrap.cc:492] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:50.348922 30320 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:50.359915 30541 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:50.360122 30654 ts_tablet_manager.cc:1434] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.158s user 0.007s sys 0.007s
I20260807 07:56:50.360700 31166 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:56:50.360925 30220 catalog_manager.cc:5697] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:56:50.370148 30654 tablet_bootstrap.cc:492] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:50.375038 31194 raft_consensus.cc:2749] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 07:56:50.375535 30997 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:50.376014 30997 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.383700 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:50.384404 30373 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:50.391776 30997 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:50.394953 30429 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:50.396114 31055 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:50.396472 31055 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:50.396800 31055 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:50.408891 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:50.410511 30653 tablet_bootstrap.cc:654] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
W20260807 07:56:50.414080 30429 leader_election.cc:343] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:50.419564 31055 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.413786 30654 tablet_bootstrap.cc:654] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:50.423730 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:56:50.426285 30429 leader_election.cc:343] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:50.422740 31055 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:50.423455 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:50.438485 30373 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:50.446990 30653 tablet_bootstrap.cc:492] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:50.447417 30653 ts_tablet_manager.cc:1403] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.099s user 0.007s sys 0.007s
I20260807 07:56:50.452986 30653 raft_consensus.cc:359] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.448133 30373 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:50.454145 30653 raft_consensus.cc:385] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:50.454457 30653 raft_consensus.cc:740] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.455245 30653 consensus_queue.cc:260] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.457819 30653 ts_tablet_manager.cc:1434] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.010s user 0.005s sys 0.003s
I20260807 07:56:50.458031 30429 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:56:50.458906 30653 tablet_bootstrap.cc:492] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:50.461345 31191 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:50.462107 31191 raft_consensus.cc:697] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:50.463163 31191 consensus_queue.cc:237] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.467818 30658 tablet_bootstrap.cc:492] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:50.468264 30658 ts_tablet_manager.cc:1403] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.289s user 0.018s sys 0.014s
I20260807 07:56:50.471374 30658 raft_consensus.cc:359] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.471827 30658 raft_consensus.cc:385] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:50.471987 30658 raft_consensus.cc:740] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.472761 30658 consensus_queue.cc:260] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.474828 30654 tablet_bootstrap.cc:492] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:50.475315 30654 ts_tablet_manager.cc:1403] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.108s user 0.010s sys 0.013s
I20260807 07:56:50.478891 30654 raft_consensus.cc:359] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.479535 30654 raft_consensus.cc:385] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:50.479873 30654 raft_consensus.cc:740] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.480628 30654 consensus_queue.cc:260] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.482406 30658 ts_tablet_manager.cc:1434] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.014s user 0.000s sys 0.008s
I20260807 07:56:50.483517 30658 tablet_bootstrap.cc:492] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:50.493757 30654 ts_tablet_manager.cc:1434] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.018s user 0.006s sys 0.002s
I20260807 07:56:50.495644 30654 tablet_bootstrap.cc:492] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:50.496299 31206 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:50.496837 31206 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.513216 30653 tablet_bootstrap.cc:654] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:50.508392 31206 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:50.516568 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:50.521019 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:56:50.523005 30539 leader_election.cc:343] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:50.528086 30360 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:50.531453 30541 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:50.532474 31184 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:50.533564 30658 tablet_bootstrap.cc:654] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:50.533776 30373 raft_consensus.cc:3060] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:50.533001 31184 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:50.534915 31184 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:50.544227 30221 catalog_manager.cc:5697] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:50.551272 30653 tablet_bootstrap.cc:492] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:50.559763 30653 ts_tablet_manager.cc:1403] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.101s user 0.005s sys 0.015s
I20260807 07:56:50.567601 31184 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.577680 30653 raft_consensus.cc:359] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.578488 30653 raft_consensus.cc:385] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:50.578771 30653 raft_consensus.cc:740] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.579118 30654 tablet_bootstrap.cc:654] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:50.579530 30653 consensus_queue.cc:260] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.579778 31055 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:50.587704 30653 ts_tablet_manager.cc:1434] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.028s user 0.004s sys 0.004s
I20260807 07:56:50.588936 30653 tablet_bootstrap.cc:492] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:50.581605 31055 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.589991 31194 consensus_queue.cc:1048] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:50.590906 31055 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:50.594049 30220 catalog_manager.cc:5697] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:50.595306 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:50.602409 30587 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:50.603276 30220 catalog_manager.cc:5697] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:50.608574 31166 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:50.595304 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:50.614198 30658 tablet_bootstrap.cc:492] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:50.616446 30429 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:50.617838 30658 ts_tablet_manager.cc:1403] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.133s user 0.015s sys 0.019s
I20260807 07:56:50.595489 31194 consensus_queue.cc:1048] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260807 07:56:50.609016 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:50.623987 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:50.621274 31184 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:50.627492 31164 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:50.627961 31164 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.618393 30360 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:50.620399 31191 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:50.637369 31164 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:50.641722 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:50.648044 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:50.649770 30320 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:50.612882 31166 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.659369 30653 tablet_bootstrap.cc:654] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:50.642828 31191 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:50.664839 31191 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:50.664389 31228 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:56:50.663673 30373 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:50.671727 31166 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:50.673935 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:56:50.681315 30539 leader_election.cc:343] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:50.687070 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:50.687712 30581 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:50.691250 30320 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:50.693656 30360 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:50.700910 30541 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:50.697539 31228 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:50.710727 31228 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:50.717949 31228 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:50.717489 31187 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:50.718408 30658 raft_consensus.cc:359] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.721444 30658 raft_consensus.cc:385] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:50.721760 30658 raft_consensus.cc:740] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.730484 31191 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.732466 30478 raft_consensus.cc:2393] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 1: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:56:50.731132 30658 consensus_queue.cc:260] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.731622 31187 raft_consensus.cc:697] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
W20260807 07:56:50.734361 30294 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:56:50.747184 30654 tablet_bootstrap.cc:492] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:50.747696 30654 ts_tablet_manager.cc:1403] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.252s user 0.018s sys 0.003s
I20260807 07:56:50.744906 31228 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.750689 30654 raft_consensus.cc:359] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.751300 30654 raft_consensus.cc:385] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:50.751560 30654 raft_consensus.cc:740] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.747072 31191 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:50.759922 30658 ts_tablet_manager.cc:1434] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.142s user 0.005s sys 0.001s
I20260807 07:56:50.760658 30654 consensus_queue.cc:260] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.752907 31165 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:50.764246 30658 tablet_bootstrap.cc:492] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:50.753494 30997 consensus_queue.cc:1048] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260807 07:56:50.766736 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:50.767309 30581 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:50.763872 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:50.744797 31187 consensus_queue.cc:237] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.773324 30360 raft_consensus.cc:2393] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:56:50.776902 30654 ts_tablet_manager.cc:1434] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.029s user 0.007s sys 0.000s
I20260807 07:56:50.764050 31165 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.785121 31165 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:50.785852 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:56:50.787091 30317 leader_election.cc:343] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:50.793097 30654 tablet_bootstrap.cc:492] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:50.801606 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:50.802162 30581 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:50.802348 30479 raft_consensus.cc:2393] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 1: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:56:50.793609 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:50.803889 30429 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:56:50.809468 31228 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:50.810797 30997 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
W20260807 07:56:50.811424 30320 leader_election.cc:343] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:50.811640 30997 raft_consensus.cc:697] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:50.811849 30320 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:50.813271 31228 raft_consensus.cc:2749] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:50.811728 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:50.814677 30582 raft_consensus.cc:2393] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 1: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:56:50.812475 30997 consensus_queue.cc:237] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.819082 30658 tablet_bootstrap.cc:654] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:50.820663 30320 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:56:50.826061 31165 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 07:56:50.828655 30653 tablet_bootstrap.cc:492] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:50.829118 30653 ts_tablet_manager.cc:1403] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.240s user 0.015s sys 0.006s
I20260807 07:56:50.837718 30222 catalog_manager.cc:5697] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:50.840373 31199 consensus_queue.cc:1048] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:50.841576 30654 tablet_bootstrap.cc:654] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:50.848631 30653 raft_consensus.cc:359] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.849349 30653 raft_consensus.cc:385] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:50.849654 30653 raft_consensus.cc:740] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.850817 30653 consensus_queue.cc:260] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.856612 30653 ts_tablet_manager.cc:1434] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.027s user 0.005s sys 0.002s
I20260807 07:56:50.857585 30653 tablet_bootstrap.cc:492] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:50.860343 30221 catalog_manager.cc:5697] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:50.878187 31150 consensus_queue.cc:1048] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:50.896890 30653 tablet_bootstrap.cc:654] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:50.907169 30654 tablet_bootstrap.cc:492] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:50.907384 30658 tablet_bootstrap.cc:492] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:50.907668 30654 ts_tablet_manager.cc:1403] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.124s user 0.025s sys 0.009s
I20260807 07:56:50.907851 30658 ts_tablet_manager.cc:1403] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.145s user 0.037s sys 0.013s
I20260807 07:56:50.906952 30581 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:50.916596 30658 raft_consensus.cc:359] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.917273 30658 raft_consensus.cc:385] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:50.918213 30658 raft_consensus.cc:740] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.919551 30658 consensus_queue.cc:260] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.925076 30654 raft_consensus.cc:359] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.925853 30654 raft_consensus.cc:385] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:50.926105 30654 raft_consensus.cc:740] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.926481 31199 consensus_queue.cc:1048] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:50.927131 30658 ts_tablet_manager.cc:1434] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.019s user 0.003s sys 0.003s
I20260807 07:56:50.928650 30654 consensus_queue.cc:260] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.931154 30654 ts_tablet_manager.cc:1434] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.023s user 0.005s sys 0.001s
I20260807 07:56:50.932286 30654 tablet_bootstrap.cc:492] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:50.934690 30653 tablet_bootstrap.cc:492] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:50.935225 30653 ts_tablet_manager.cc:1403] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.078s user 0.015s sys 0.000s
I20260807 07:56:50.936009 30658 tablet_bootstrap.cc:492] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:50.957062 30658 tablet_bootstrap.cc:654] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:50.965818 31187 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:50.966516 31187 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.974239 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:50.976166 31187 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:50.977456 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:50.979033 30653 raft_consensus.cc:359] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:56:50.979578 30539 leader_election.cc:343] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:50.981735 30653 raft_consensus.cc:385] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260807 07:56:50.982048 30541 leader_election.cc:343] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:50.982517 30541 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:50.987951 30654 tablet_bootstrap.cc:654] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:50.992911 31187 raft_consensus.cc:2749] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:50.982115 30653 raft_consensus.cc:740] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:50.998179 30653 consensus_queue.cc:260] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:50.999861 30653 ts_tablet_manager.cc:1434] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.056s user 0.006s sys 0.000s
I20260807 07:56:51.001844 30653 tablet_bootstrap.cc:492] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:51.023861 30654 tablet_bootstrap.cc:492] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:51.027251 30654 ts_tablet_manager.cc:1403] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.095s user 0.009s sys 0.007s
I20260807 07:56:51.031351 30654 raft_consensus.cc:359] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.037484 30653 tablet_bootstrap.cc:654] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:51.039374 30654 raft_consensus.cc:385] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.040086 30654 raft_consensus.cc:740] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.040760 30997 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:51.041182 30654 consensus_queue.cc:260] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.041597 30997 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.044875 30654 ts_tablet_manager.cc:1434] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260807 07:56:51.046315 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:51.047646 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:51.048280 30363 raft_consensus.cc:2393] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:56:51.049640 30997 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.049911 30429 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:51.050999 30997 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.068740 30997 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:51.069335 30654 tablet_bootstrap.cc:492] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:51.075474 30658 tablet_bootstrap.cc:492] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:51.075985 30658 ts_tablet_manager.cc:1403] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.140s user 0.011s sys 0.016s
I20260807 07:56:51.079887 30658 raft_consensus.cc:359] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.080556 30658 raft_consensus.cc:385] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.080794 30658 raft_consensus.cc:740] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.081471 30658 consensus_queue.cc:260] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.083730 30658 ts_tablet_manager.cc:1434] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260807 07:56:51.083844 30653 tablet_bootstrap.cc:492] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:51.084357 30653 ts_tablet_manager.cc:1403] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.083s user 0.017s sys 0.014s
I20260807 07:56:51.086625 30658 tablet_bootstrap.cc:492] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:51.091522 30654 tablet_bootstrap.cc:654] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:51.092903 30653 raft_consensus.cc:359] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.096057 30653 raft_consensus.cc:385] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.096422 30653 raft_consensus.cc:740] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.097537 30658 tablet_bootstrap.cc:654] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:51.097162 30653 consensus_queue.cc:260] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.099601 30653 ts_tablet_manager.cc:1434] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260807 07:56:51.101732 30653 tablet_bootstrap.cc:492] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:51.123670 31228 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:51.124171 31228 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.126232 31228 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.128975 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:51.131664 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:51.132357 30581 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
W20260807 07:56:51.143375 30317 leader_election.cc:343] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:51.144567 30658 tablet_bootstrap.cc:492] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:51.145100 30658 ts_tablet_manager.cc:1403] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.009s
I20260807 07:56:51.149771 30658 raft_consensus.cc:359] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.150454 30658 raft_consensus.cc:385] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.150687 30654 tablet_bootstrap.cc:492] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:51.150769 30658 raft_consensus.cc:740] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.151309 30654 ts_tablet_manager.cc:1403] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.082s user 0.016s sys 0.000s
I20260807 07:56:51.151587 30658 consensus_queue.cc:260] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.152328 31228 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:51.152833 31228 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.153687 30658 ts_tablet_manager.cc:1434] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 07:56:51.154819 30320 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:51.155179 31228 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.155906 30658 tablet_bootstrap.cc:492] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:51.156517 31228 raft_consensus.cc:2804] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:51.156930 31228 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:51.159068 31228 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.161775 30658 tablet_bootstrap.cc:654] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:51.162987 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:51.176355 30581 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:51.176429 31228 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.178514 31228 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.168184 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:51.178701 30654 raft_consensus.cc:359] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.179474 30654 raft_consensus.cc:385] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.179759 30654 raft_consensus.cc:740] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.179786 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:56:51.180554 30317 leader_election.cc:343] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:51.180473 30654 consensus_queue.cc:260] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:56:51.181434 30317 leader_election.cc:343] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:51.163321 30653 tablet_bootstrap.cc:654] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:51.181509 30320 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:51.185211 31228 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:51.185644 31228 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:51.186000 31228 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.187343 30658 tablet_bootstrap.cc:492] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:51.187716 30658 ts_tablet_manager.cc:1403] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.032s user 0.009s sys 0.000s
I20260807 07:56:51.189505 30658 raft_consensus.cc:359] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.190187 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:51.183507 30654 ts_tablet_manager.cc:1434] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
I20260807 07:56:51.191143 30581 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.190187 30658 raft_consensus.cc:385] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.191730 30658 raft_consensus.cc:740] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.192373 30658 consensus_queue.cc:260] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.193110 30654 tablet_bootstrap.cc:492] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:51.194368 30658 ts_tablet_manager.cc:1434] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260807 07:56:51.195860 30658 tablet_bootstrap.cc:492] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:51.192379 31228 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.202562 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:56:51.203867 30317 leader_election.cc:343] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:51.207158 30658 tablet_bootstrap.cc:654] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:51.207419 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:51.207967 30582 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.211077 31228 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.212026 30581 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:51.214926 30320 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:51.220044 30654 tablet_bootstrap.cc:654] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:51.223064 31165 raft_consensus.cc:2804] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:51.223582 31165 raft_consensus.cc:697] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:51.224373 31165 consensus_queue.cc:237] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.226532 30658 tablet_bootstrap.cc:492] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:51.227025 30658 ts_tablet_manager.cc:1403] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.006s
I20260807 07:56:51.243435 30658 raft_consensus.cc:359] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.244259 30658 raft_consensus.cc:385] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.244593 30658 raft_consensus.cc:740] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.245407 30658 consensus_queue.cc:260] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.251896 30658 ts_tablet_manager.cc:1434] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.025s user 0.005s sys 0.004s
I20260807 07:56:51.214931 30582 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:51.254201 30320 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:51.253047 31194 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:51.256498 30658 tablet_bootstrap.cc:492] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:51.258013 30654 tablet_bootstrap.cc:492] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:51.258585 30654 ts_tablet_manager.cc:1403] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.066s user 0.017s sys 0.017s
I20260807 07:56:51.257578 31228 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:51.260625 30997 consensus_queue.cc:1048] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:51.262792 31228 raft_consensus.cc:697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:51.263928 31228 consensus_queue.cc:237] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.255851 31194 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.269936 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:51.270720 30366 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
I20260807 07:56:51.270880 30221 catalog_manager.cc:5697] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:51.272967 30997 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:51.273699 30997 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.274471 30541 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:51.276680 31169 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:51.277046 31169 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:51.277456 31169 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.277690 31194 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:51.276899 30997 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.279820 31199 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:51.280544 31199 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.283401 31199 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.283757 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:51.285836 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:51.288684 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:56:51.289939 30429 leader_election.cc:343] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
W20260807 07:56:51.290675 30429 leader_election.cc:343] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:51.294924 30654 raft_consensus.cc:359] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.296464 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:51.296850 30654 raft_consensus.cc:385] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.297605 30654 raft_consensus.cc:740] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.297338 30587 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:51.297437 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:51.305624 30488 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 0.
W20260807 07:56:51.298588 30429 leader_election.cc:343] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:51.306109 30654 consensus_queue.cc:260] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.307474 30429 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:51.302624 30653 tablet_bootstrap.cc:492] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:51.308677 30653 ts_tablet_manager.cc:1403] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.207s user 0.016s sys 0.014s
I20260807 07:56:51.309789 30429 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:56:51.310055 31055 consensus_queue.cc:1048] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:51.311556 31183 raft_consensus.cc:2804] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:51.312126 31183 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:51.312615 31183 raft_consensus.cc:3060] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.309319 31150 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:51.330734 30654 ts_tablet_manager.cc:1434] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.070s user 0.007s sys 0.000s
I20260807 07:56:51.332136 30654 tablet_bootstrap.cc:492] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:51.336519 30653 raft_consensus.cc:359] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.337086 30653 raft_consensus.cc:385] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.337320 30653 raft_consensus.cc:740] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.337996 30653 consensus_queue.cc:260] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.338627 31169 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.339480 30653 ts_tablet_manager.cc:1434] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.031s user 0.005s sys 0.002s
I20260807 07:56:51.340504 30653 tablet_bootstrap.cc:492] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:51.341732 31165 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:51.342221 31165 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.344596 31165 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.348888 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:51.355640 30658 tablet_bootstrap.cc:654] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:51.356331 30220 catalog_manager.cc:5697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:51.333324 31184 consensus_queue.cc:1048] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260807 07:56:51.363130 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:51.363931 30582 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
W20260807 07:56:51.364411 30317 leader_election.cc:343] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:51.365705 30320 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:51.371448 31169 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:51.374634 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:51.375402 30373 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.375118 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:51.376137 30488 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.373908 31228 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:51.381918 31228 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:51.382472 31228 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.390900 31055 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:51.391461 31055 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.394061 31055 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.402333 31206 consensus_queue.cc:1048] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:51.423658 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:51.424480 30581 raft_consensus.cc:2393] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:56:51.426447 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:51.431672 31183 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.434556 31183 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.439015 30373 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:51.444991 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:51.447278 30373 raft_consensus.cc:3060] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.451115 30429 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:51.451916 31199 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.454764 30373 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:51.456738 30541 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:51.455682 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:51.457422 30581 raft_consensus.cc:3060] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.458153 31199 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:51.459668 30429 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:51.463981 30654 tablet_bootstrap.cc:654] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:51.463510 31199 raft_consensus.cc:2804] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:51.465677 31199 raft_consensus.cc:697] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:51.467903 31169 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:51.466506 31199 consensus_queue.cc:237] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.487000 30658 tablet_bootstrap.cc:492] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:51.487483 30658 ts_tablet_manager.cc:1403] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.231s user 0.030s sys 0.021s
I20260807 07:56:51.487938 30653 tablet_bootstrap.cc:654] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:51.482616 30488 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:56:51.490162 31169 raft_consensus.cc:697] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:56:51.495986 31169 consensus_queue.cc:237] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.501528 30581 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:51.507292 31228 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.510243 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:56:51.511581 30317 leader_election.cc:343] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): Illegal state: must be running to vote when last-logged opid is not known
I20260807 07:56:51.518483 31228 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.525592 30658 raft_consensus.cc:359] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.526321 30658 raft_consensus.cc:385] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.526579 30658 raft_consensus.cc:740] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.527231 30658 consensus_queue.cc:260] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.528724 30658 ts_tablet_manager.cc:1434] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.041s user 0.007s sys 0.003s
I20260807 07:56:51.530601 30658 tablet_bootstrap.cc:492] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818: Bootstrap starting.
I20260807 07:56:51.530243 30222 catalog_manager.cc:5697] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 0 to 1, leader changed from <none> to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:56:51.537312 30221 catalog_manager.cc:5697] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:51.545452 30654 tablet_bootstrap.cc:492] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:51.572029 30654 ts_tablet_manager.cc:1403] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.240s user 0.009s sys 0.011s
I20260807 07:56:51.546118 30658 tablet_bootstrap.cc:654] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:51.674876 30658 tablet_bootstrap.cc:492] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818: No bootstrap required, opened a new log
I20260807 07:56:51.675376 30658 ts_tablet_manager.cc:1403] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818: Time spent bootstrapping tablet: real 0.145s user 0.011s sys 0.003s
I20260807 07:56:51.676119 30654 raft_consensus.cc:359] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.680415 30654 raft_consensus.cc:385] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.680968 30654 raft_consensus.cc:740] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.678380 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:51.678812 30653 tablet_bootstrap.cc:492] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:51.681759 30653 ts_tablet_manager.cc:1403] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.341s user 0.034s sys 0.021s
I20260807 07:56:51.681866 30654 consensus_queue.cc:260] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.687239 30654 ts_tablet_manager.cc:1434] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.115s user 0.015s sys 0.012s
W20260807 07:56:51.691519 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 85660.8us
I20260807 07:56:51.712934 30653 raft_consensus.cc:359] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.713786 30653 raft_consensus.cc:385] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.714071 30653 raft_consensus.cc:740] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.714697 30653 consensus_queue.cc:260] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.716291 30654 tablet_bootstrap.cc:492] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e: Bootstrap starting.
I20260807 07:56:51.716924 30653 ts_tablet_manager.cc:1434] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.035s user 0.002s sys 0.005s
I20260807 07:56:51.723584 30654 tablet_bootstrap.cc:654] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:51.724081 31288 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:51.732043 31288 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.684135 30582 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.734194 31288 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.742056 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:51.742784 30587 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:51.751536 30653 tablet_bootstrap.cc:492] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19: Bootstrap starting.
I20260807 07:56:51.758389 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:51.758998 30372 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 0.
I20260807 07:56:51.719877 30658 raft_consensus.cc:359] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.760030 31228 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:51.760545 30658 raft_consensus.cc:385] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.760855 30658 raft_consensus.cc:740] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.759989 30654 tablet_bootstrap.cc:492] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e: No bootstrap required, opened a new log
I20260807 07:56:51.765189 30654 ts_tablet_manager.cc:1403] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e: Time spent bootstrapping tablet: real 0.049s user 0.018s sys 0.011s
I20260807 07:56:51.767045 30429 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:56:51.769486 31199 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:51.769836 31199 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:51.770133 31199 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.771281 30654 raft_consensus.cc:359] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.771953 30654 raft_consensus.cc:385] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.772226 30654 raft_consensus.cc:740] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.761477 30658 consensus_queue.cc:260] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.772866 30654 consensus_queue.cc:260] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.775213 30658 ts_tablet_manager.cc:1434] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818: Time spent starting tablet: real 0.100s user 0.007s sys 0.000s
I20260807 07:56:51.779197 30654 ts_tablet_manager.cc:1434] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
W20260807 07:56:51.788146 30294 auto_rebalancer.cc:300] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260807 07:56:51.787539 31199 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.792088 30582 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:51.803500 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:51.804111 30582 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.806303 31199 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.809607 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:56:51.810159 30367 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.811925 30582 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:51.813024 30429 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:51.814635 31288 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:51.815092 31288 raft_consensus.cc:697] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:56:51.799010 30653 tablet_bootstrap.cc:654] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19: Neither blocks nor log segments found. Creating new log.
I20260807 07:56:51.817166 30367 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:56:51.819242 31288 consensus_queue.cc:237] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.832856 30320 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:56:51.833693 31228 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:51.834211 31228 raft_consensus.cc:697] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:51.834998 31228 consensus_queue.cc:237] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.851326 31228 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:51.851116 30221 catalog_manager.cc:5697] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:51.854564 31164 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:51.856994 30479 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.876543 31165 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:51.877815 30222 catalog_manager.cc:5697] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:51.880970 30653 tablet_bootstrap.cc:492] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19: No bootstrap required, opened a new log
I20260807 07:56:51.882027 30653 ts_tablet_manager.cc:1403] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19: Time spent bootstrapping tablet: real 0.131s user 0.014s sys 0.018s
I20260807 07:56:51.885280 30653 raft_consensus.cc:359] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.885910 30653 raft_consensus.cc:385] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 07:56:51.886210 30653 raft_consensus.cc:740] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Initialized, Role: FOLLOWER
I20260807 07:56:51.886868 30653 consensus_queue.cc:260] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.889194 30653 ts_tablet_manager.cc:1434] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260807 07:56:51.896040 31165 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:51.896780 31165 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.899888 31165 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.901222 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:51.902104 30586 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:51.903580 30320 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:51.903157 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:56:51.906809 30478 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 0.
I20260807 07:56:51.908020 31165 raft_consensus.cc:2804] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 07:56:51.908485 31165 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:56:51.908911 31165 raft_consensus.cc:3060] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.919480 31165 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.922849 31165 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.926211 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:56:51.927062 30586 raft_consensus.cc:3060] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.927088 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:56:51.928933 30479 raft_consensus.cc:3060] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.928601 31199 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:51.938599 30586 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:51.940012 30320 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:56:51.940871 31228 raft_consensus.cc:2804] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 07:56:51.941735 31228 raft_consensus.cc:697] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:56:51.941795 30479 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:56:51.943454 31228 consensus_queue.cc:237] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.948745 31055 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:56:51.949311 31055 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:51.952209 31055 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:51.955791 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:56:51.956521 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:56:51.957839 30582 raft_consensus.cc:2393] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 1: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:56:51.959164 30429 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:56:51.959892 31055 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 0 FOLLOWER]: Advancing to term 1
I20260807 07:56:51.969732 31055 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 07:56:51.971370 31055 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:51.973008 30220 catalog_manager.cc:5697] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:52.014195 27906 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260807 07:56:52.028496 31319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:52.034108 31321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 07:56:52.035988 31324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 07:56:52.048015 27906 server_base.cc:1061] running on GCE node
I20260807 07:56:52.049774 27906 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260807 07:56:52.050102 27906 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260807 07:56:52.050323 27906 hybrid_clock.cc:648] HybridClock initialized: now 1786089412050305 us; error 0 us; skew 500 ppm
I20260807 07:56:52.051039 27906 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 07:56:52.050791 31184 consensus_queue.cc:1048] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:52.055320 27906 webserver.cc:533] Webserver started at http://127.27.64.132:40197/ using document root <none> and password file <none>
I20260807 07:56:52.055866 27906 fs_manager.cc:362] Metadata directory not provided
I20260807 07:56:52.056113 27906 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 07:56:52.056496 27906 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 07:56:52.058461 27906 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-3-root/instance:
uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
format_stamp: "Formatted at 2026-08-07 07:56:52 on dist-test-slave-f0tn"
I20260807 07:56:52.061636 31194 consensus_queue.cc:1048] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 07:56:52.094283 27906 fs_manager.cc:696] Time spent creating directory manager: real 0.035s user 0.009s sys 0.018s
I20260807 07:56:52.099182 31335 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:52.100183 27906 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 07:56:52.100495 27906 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-3-root
uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
format_stamp: "Formatted at 2026-08-07 07:56:52 on dist-test-slave-f0tn"
I20260807 07:56:52.100775 27906 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 07:56:52.124393 27906 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260807 07:56:52.127018 27906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 07:56:52.129732 27906 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260807 07:56:52.133957 27906 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 07:56:52.134223 27906 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:52.134588 27906 ts_tablet_manager.cc:616] Registered 0 tablets
I20260807 07:56:52.134752 27906 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 07:56:52.335072 31228 consensus_queue.cc:1048] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:52.347486 31418 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.64.132:36619 every 8 connection(s)
I20260807 07:56:52.348532 27906 rpc_server.cc:307] RPC server started. Bound to: 127.27.64.132:36619
I20260807 07:56:52.353466 31228 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:52.372751 31165 consensus_queue.cc:1048] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:52.392761 31288 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:52.438854 31283 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260807 07:56:52.505082 27906 auto_leader_rebalancer-test.cc:581] add a tserver: 6bd20e9c0d3e4ace86fc1f55ab9425fa
W20260807 07:56:52.687270 31427 log.cc:927] Time spent T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.163s user 0.002s sys 0.000s
W20260807 07:56:52.698226 31432 log.cc:927] Time spent T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.079s user 0.001s sys 0.000s
W20260807 07:56:52.792054 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 353293us
I20260807 07:56:52.849200 31420 heartbeater.cc:344] Connected to a master server at 127.27.64.190:42791
I20260807 07:56:52.849911 31420 heartbeater.cc:461] Registering TS with master...
I20260807 07:56:52.854296 31420 heartbeater.cc:507] Master 127.27.64.190:42791 requested a full tablet report, sending...
I20260807 07:56:52.885466 30220 ts_manager.cc:194] Registered new tserver with Master: 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:56:52.968876 30220 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40988
I20260807 07:56:52.979887 31164 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 07:56:53.977559 31420 heartbeater.cc:499] Master 127.27.64.190:42791 was elected leader, sending a full tablet report...
I20260807 07:56:54.091312 30488 consensus_queue.cc:237] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:54.099903 30369 raft_consensus.cc:1275] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:54.099923 30582 raft_consensus.cc:1275] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:54.101718 31457 consensus_queue.cc:1048] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:56:54.103173 31465 consensus_queue.cc:1048] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 07:56:54.112926 30430 consensus_peers.cc:597] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 30057a01f5fa4baba4b3b02fe84a0f78. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:54.121445 31457 raft_consensus.cc:2955] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.134891 30369 raft_consensus.cc:2955] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.153733 30221 catalog_manager.cc:5697] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.154995 30582 raft_consensus.cc:2955] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.174336 30582 consensus_queue.cc:237] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:54.193442 30369 raft_consensus.cc:1275] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:54.195472 30479 raft_consensus.cc:1275] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:54.197296 31464 consensus_queue.cc:1048] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:56:54.198258 31184 consensus_queue.cc:1048] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 07:56:54.213150 30542 consensus_peers.cc:597] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f5785da4aac4398afc22beefd2bd76b. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:54.227140 31500 raft_consensus.cc:2955] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.228259 30365 raft_consensus.cc:2955] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.239648 30489 raft_consensus.cc:2955] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.249399 30220 catalog_manager.cc:5697] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.251369 30479 consensus_queue.cc:237] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:56:54.275738 30430 consensus_peers.cc:597] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0032603adf8446cd9a59f26cc868400c. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:54.277755 30585 raft_consensus.cc:1275] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:54.278793 30365 raft_consensus.cc:1275] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:54.279327 31199 consensus_queue.cc:1048] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:56:54.280215 31465 consensus_queue.cc:1048] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:54.289076 31199 raft_consensus.cc:2955] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.297315 30585 raft_consensus.cc:2955] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.300999 30582 consensus_queue.cc:237] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:54.300765 30369 raft_consensus.cc:2955] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.308391 30221 catalog_manager.cc:5697] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260807 07:56:54.332952 30542 consensus_peers.cc:597] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a35e1cb09e2146a084cf577b068e4140. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:54.335999 30488 raft_consensus.cc:1275] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:54.338018 30369 raft_consensus.cc:1275] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:54.339344 31500 consensus_queue.cc:1048] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:54.341904 31464 consensus_queue.cc:1048] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:54.353353 31464 raft_consensus.cc:2955] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.355194 30364 raft_consensus.cc:2955] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.370067 30488 raft_consensus.cc:2955] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:54.371089 30221 catalog_manager.cc:5697] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 07:56:54.610152 31515 ts_tablet_manager.cc:933] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:54.612218 31515 tablet_copy_client.cc:323] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
I20260807 07:56:54.629356 30503 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet 30057a01f5fa4baba4b3b02fe84a0f78 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
I20260807 07:56:54.630057 30503 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet 30057a01f5fa4baba4b3b02fe84a0f78 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-30057a01f5fa4baba4b3b02fe84a0f78
I20260807 07:56:54.636554 30503 tablet_copy_source_session.cc:215] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:56:54.640301 31515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30057a01f5fa4baba4b3b02fe84a0f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:54.653605 31515 tablet_copy_client.cc:806] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:56:54.654243 31515 tablet_copy_client.cc:670] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:56:54.659322 31515 tablet_copy_client.cc:538] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:56:54.668133 31515 tablet_bootstrap.cc:492] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:56:54.725952 31515 tablet_bootstrap.cc:492] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:56:54.726956 31515 tablet_bootstrap.cc:492] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:56:54.727665 31515 ts_tablet_manager.cc:1403] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.060s user 0.022s sys 0.007s
I20260807 07:56:54.735307 31515 raft_consensus.cc:359] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:54.736140 31515 raft_consensus.cc:740] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:56:54.736824 31515 consensus_queue.cc:260] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:54.738705 31526 ts_tablet_manager.cc:933] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:54.749459 31526 tablet_copy_client.cc:323] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.131:33207
I20260807 07:56:54.758731 31515 ts_tablet_manager.cc:1434] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.031s user 0.006s sys 0.006s
I20260807 07:56:54.760589 30503 tablet_copy_service.cc:342] P ef1ca7acf52a438f89f14707e9e06818: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-30057a01f5fa4baba4b3b02fe84a0f78 received from {username='slave'} at 127.0.0.1:34358
I20260807 07:56:54.761112 30503 tablet_copy_service.cc:434] P ef1ca7acf52a438f89f14707e9e06818: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-30057a01f5fa4baba4b3b02fe84a0f78 on tablet 30057a01f5fa4baba4b3b02fe84a0f78 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:56:54.761533 31525 ts_tablet_manager.cc:933] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:54.779595 30605 tablet_copy_service.cc:140] P f831a53ec51d452398015797d543164e: Received BeginTabletCopySession request for tablet 1f5785da4aac4398afc22beefd2bd76b from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:42218)
I20260807 07:56:54.779856 31525 tablet_copy_client.cc:323] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
I20260807 07:56:54.780260 30605 tablet_copy_service.cc:161] P f831a53ec51d452398015797d543164e: Beginning new tablet copy session on tablet 1f5785da4aac4398afc22beefd2bd76b from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:42218: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-1f5785da4aac4398afc22beefd2bd76b
I20260807 07:56:54.781708 30503 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet 0032603adf8446cd9a59f26cc868400c from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
I20260807 07:56:54.782277 30503 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet 0032603adf8446cd9a59f26cc868400c from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-0032603adf8446cd9a59f26cc868400c
I20260807 07:56:54.788421 30605 tablet_copy_source_session.cc:215] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:56:54.791373 30503 tablet_copy_source_session.cc:215] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:56:54.791708 31526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5785da4aac4398afc22beefd2bd76b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:54.794530 31525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0032603adf8446cd9a59f26cc868400c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:54.806586 31526 tablet_copy_client.cc:806] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:56:54.807109 31526 tablet_copy_client.cc:670] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:56:54.814394 31525 tablet_copy_client.cc:806] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:56:54.814894 31525 tablet_copy_client.cc:670] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:56:54.818612 31525 tablet_copy_client.cc:538] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:56:54.826205 31526 tablet_copy_client.cc:538] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:56:54.827023 31525 tablet_bootstrap.cc:492] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:56:54.837077 31526 tablet_bootstrap.cc:492] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:56:54.853406 31525 tablet_bootstrap.cc:492] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:56:54.854274 31525 tablet_bootstrap.cc:492] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:56:54.854961 31525 ts_tablet_manager.cc:1403] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.028s user 0.015s sys 0.006s
I20260807 07:56:54.857692 31525 raft_consensus.cc:359] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:54.858522 31525 raft_consensus.cc:740] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:56:54.859133 31525 consensus_queue.cc:260] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:54.861297 31525 ts_tablet_manager.cc:1434] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260807 07:56:54.861855 31526 tablet_bootstrap.cc:492] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:56:54.863037 31526 tablet_bootstrap.cc:492] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:56:54.863394 30503 tablet_copy_service.cc:342] P ef1ca7acf52a438f89f14707e9e06818: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-0032603adf8446cd9a59f26cc868400c received from {username='slave'} at 127.0.0.1:34358
I20260807 07:56:54.863664 31526 ts_tablet_manager.cc:1403] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.027s user 0.017s sys 0.004s
I20260807 07:56:54.863794 30503 tablet_copy_service.cc:434] P ef1ca7acf52a438f89f14707e9e06818: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-0032603adf8446cd9a59f26cc868400c on tablet 0032603adf8446cd9a59f26cc868400c with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:56:54.871138 31526 raft_consensus.cc:359] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:54.871939 31526 raft_consensus.cc:740] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:56:54.872560 31526 consensus_queue.cc:260] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:54.881300 31526 ts_tablet_manager.cc:1434] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260807 07:56:54.885339 30605 tablet_copy_service.cc:342] P f831a53ec51d452398015797d543164e: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-1f5785da4aac4398afc22beefd2bd76b received from {username='slave'} at 127.0.0.1:42218
I20260807 07:56:54.885766 30605 tablet_copy_service.cc:434] P f831a53ec51d452398015797d543164e: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-1f5785da4aac4398afc22beefd2bd76b on tablet 1f5785da4aac4398afc22beefd2bd76b with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:56:54.944422 31526 ts_tablet_manager.cc:933] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:54.946908 31526 tablet_copy_client.cc:323] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.131:33207
I20260807 07:56:54.948356 30605 tablet_copy_service.cc:140] P f831a53ec51d452398015797d543164e: Received BeginTabletCopySession request for tablet a35e1cb09e2146a084cf577b068e4140 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:42218)
I20260807 07:56:54.948779 30605 tablet_copy_service.cc:161] P f831a53ec51d452398015797d543164e: Beginning new tablet copy session on tablet a35e1cb09e2146a084cf577b068e4140 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:42218: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-a35e1cb09e2146a084cf577b068e4140
I20260807 07:56:54.953451 30605 tablet_copy_source_session.cc:215] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:56:54.955825 31526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a35e1cb09e2146a084cf577b068e4140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:56:54.970615 31526 tablet_copy_client.cc:806] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:56:54.971207 31526 tablet_copy_client.cc:670] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:56:54.975369 31526 tablet_copy_client.cc:538] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:56:54.983861 31526 tablet_bootstrap.cc:492] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:56:55.002151 31526 tablet_bootstrap.cc:492] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:56:55.002825 31526 tablet_bootstrap.cc:492] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:56:55.003470 31526 ts_tablet_manager.cc:1403] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.020s user 0.020s sys 0.001s
I20260807 07:56:55.005955 31526 raft_consensus.cc:359] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:55.006623 31526 raft_consensus.cc:740] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:56:55.007170 31526 consensus_queue.cc:260] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:55.009269 31526 ts_tablet_manager.cc:1434] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260807 07:56:55.011024 30605 tablet_copy_service.cc:342] P f831a53ec51d452398015797d543164e: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-a35e1cb09e2146a084cf577b068e4140 received from {username='slave'} at 127.0.0.1:42218
I20260807 07:56:55.011494 30605 tablet_copy_service.cc:434] P f831a53ec51d452398015797d543164e: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-a35e1cb09e2146a084cf577b068e4140 on tablet a35e1cb09e2146a084cf577b068e4140 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:56:55.173614 31385 raft_consensus.cc:1217] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 07:56:55.174999 31384 raft_consensus.cc:1217] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 07:56:55.182464 31384 raft_consensus.cc:1217] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 07:56:55.398944 31384 raft_consensus.cc:1217] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 07:56:55.561161 31506 raft_consensus.cc:1064] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:56:55.564189 31506 consensus_queue.cc:237] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:56:55.572062 30488 raft_consensus.cc:1275] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:56:55.573055 31384 raft_consensus.cc:1275] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:56:55.574033 31184 consensus_queue.cc:1048] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:55.574950 31464 consensus_queue.cc:1048] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:55.584568 30369 raft_consensus.cc:1275] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:56:55.586342 31506 consensus_queue.cc:1048] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:55.597306 31464 raft_consensus.cc:2955] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.599080 30488 raft_consensus.cc:2955] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.613888 30369 raft_consensus.cc:2955] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.622553 31384 raft_consensus.cc:2955] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.629853 30222 catalog_manager.cc:5697] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e reported cstate change: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:56:55.666558 30582 consensus_queue.cc:237] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:56:55.673157 31384 raft_consensus.cc:1275] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 07:56:55.675743 31464 consensus_queue.cc:1048] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:56:55.677875 31465 raft_consensus.cc:1064] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:56:55.675674 30369 raft_consensus.cc:1275] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 07:56:55.682289 31465 consensus_queue.cc:237] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:56:55.687528 31184 raft_consensus.cc:2955] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.696990 31482 raft_consensus.cc:1064] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:56:55.699591 31384 raft_consensus.cc:1275] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:56:55.701594 30365 raft_consensus.cc:1275] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:56:55.701207 31521 consensus_queue.cc:1048] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:56:55.701848 31482 consensus_queue.cc:237] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:56:55.700527 31464 consensus_queue.cc:1048] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260807 07:56:55.703552 31521 consensus_queue.cc:1048] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 07:56:55.707041 30578 raft_consensus.cc:1275] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:56:55.697552 31385 raft_consensus.cc:2955] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.710355 30365 raft_consensus.cc:2955] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.715808 31199 consensus_queue.cc:1048] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:55.720182 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f5785da4aac4398afc22beefd2bd76b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:56:55.753930 30221 catalog_manager.cc:5697] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 3 to 4, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.777072 31199 raft_consensus.cc:2955] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.791963 30585 raft_consensus.cc:2955] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.803462 30459 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f5785da4aac4398afc22beefd2bd76b with delete_type TABLET_DATA_TOMBSTONED (TS ef1ca7acf52a438f89f14707e9e06818 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33906
I20260807 07:56:55.801443 31385 raft_consensus.cc:2955] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.814111 31384 raft_consensus.cc:1275] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:56:55.821520 31199 consensus_queue.cc:1048] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:55.823377 30222 catalog_manager.cc:5697] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e reported cstate change: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.826406 30585 raft_consensus.cc:1275] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:56:55.826779 30365 raft_consensus.cc:1275] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:56:55.819444 30364 raft_consensus.cc:2955] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.830503 31564 consensus_queue.cc:1048] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:56:55.833364 31199 consensus_queue.cc:1048] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:55.860092 31566 tablet_replica.cc:333] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818: stopping tablet replica
I20260807 07:56:55.867637 31566 raft_consensus.cc:2243] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:55.869683 31566 raft_consensus.cc:2272] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:55.874403 31566 ts_tablet_manager.cc:1916] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:56:55.881201 30488 consensus_queue.cc:237] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:56:55.886107 31564 raft_consensus.cc:2955] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.889883 30365 raft_consensus.cc:2955] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.897071 31384 raft_consensus.cc:2955] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.903834 31385 raft_consensus.cc:1275] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 07:56:55.909847 31465 consensus_queue.cc:1048] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:56:55.919910 31566 ts_tablet_manager.cc:1929] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 07:56:55.920576 31566 log.cc:1199] T 1f5785da4aac4398afc22beefd2bd76b P ef1ca7acf52a438f89f14707e9e06818: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root/wals/1f5785da4aac4398afc22beefd2bd76b
I20260807 07:56:55.923092 31184 raft_consensus.cc:1064] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:56:55.926684 30201 catalog_manager.cc:5028] TS ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): tablet 1f5785da4aac4398afc22beefd2bd76b (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:56:55.925168 31184 consensus_queue.cc:237] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:56:55.932222 31465 raft_consensus.cc:2955] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.935134 30220 catalog_manager.cc:5697] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.950127 30586 raft_consensus.cc:1275] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 07:56:55.947204 30585 raft_consensus.cc:2955] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.955195 31465 consensus_queue.cc:1048] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:56:55.958647 31384 raft_consensus.cc:2955] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.964695 31385 raft_consensus.cc:1275] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:56:55.966202 30201 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0032603adf8446cd9a59f26cc868400c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:56:55.966303 31506 consensus_queue.cc:1048] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:55.968007 30479 raft_consensus.cc:1275] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:56:55.971120 31464 consensus_queue.cc:1048] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:55.973757 30221 catalog_manager.cc:5697] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 3 to 4, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.974596 30365 raft_consensus.cc:1275] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:56:55.983536 31464 consensus_queue.cc:1048] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:56:55.983819 30585 raft_consensus.cc:2955] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:55.997042 30345 tablet_service.cc:1558] Processing DeleteTablet for tablet 0032603adf8446cd9a59f26cc868400c with delete_type TABLET_DATA_TOMBSTONED (TS b1188d7d3a0b455894bc443d571f6a19 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45034
I20260807 07:56:56.010842 30489 consensus_queue.cc:237] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:56:56.019459 31384 raft_consensus.cc:1275] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 07:56:56.019896 30367 raft_consensus.cc:1275] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 07:56:56.021174 31564 consensus_queue.cc:1048] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:56:56.022204 31521 consensus_queue.cc:1048] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:56:56.030740 31574 tablet_replica.cc:333] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19: stopping tablet replica
I20260807 07:56:56.035086 31574 raft_consensus.cc:2243] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:56.035630 31574 raft_consensus.cc:2272] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:56.039860 31574 ts_tablet_manager.cc:1916] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:56:56.041011 31564 raft_consensus.cc:2955] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:56.043116 31384 raft_consensus.cc:2955] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:56.051745 31184 raft_consensus.cc:2955] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:56.055047 31385 raft_consensus.cc:2955] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:56.061107 30369 raft_consensus.cc:2955] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:56.088665 30220 catalog_manager.cc:5697] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:56.099146 30201 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 30057a01f5fa4baba4b3b02fe84a0f78 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:56:56.100893 30489 raft_consensus.cc:2955] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:56.103459 30365 raft_consensus.cc:2955] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:56.109123 30222 catalog_manager.cc:5697] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index 3 to 4, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:56:56.124301 30564 tablet_service.cc:1558] Processing DeleteTablet for tablet 30057a01f5fa4baba4b3b02fe84a0f78 with delete_type TABLET_DATA_TOMBSTONED (TS f831a53ec51d452398015797d543164e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34588
I20260807 07:56:56.124070 30585 consensus_queue.cc:237] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:56:56.144646 31384 raft_consensus.cc:1275] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 07:56:56.147119 31184 consensus_queue.cc:1048] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:56:56.152621 31576 tablet_replica.cc:333] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e: stopping tablet replica
I20260807 07:56:56.153764 31576 raft_consensus.cc:2243] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:56.154410 31576 raft_consensus.cc:2272] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:56.156111 31548 raft_consensus.cc:2955] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:56.158015 31384 raft_consensus.cc:2955] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:56.169890 30369 raft_consensus.cc:1275] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260807 07:56:56.173615 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a35e1cb09e2146a084cf577b068e4140 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:56:56.177115 31506 consensus_queue.cc:1048] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:56:56.185104 30369 raft_consensus.cc:2955] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:56:56.186065 30220 catalog_manager.cc:5697] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index 3 to 4, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New cstate: current_term: 1 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:56:56.191250 31574 ts_tablet_manager.cc:1929] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 07:56:56.191680 31574 log.cc:1199] T 0032603adf8446cd9a59f26cc868400c P b1188d7d3a0b455894bc443d571f6a19: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root/wals/0032603adf8446cd9a59f26cc868400c
I20260807 07:56:56.193481 31576 ts_tablet_manager.cc:1916] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:56:56.195006 30203 catalog_manager.cc:5028] TS b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): tablet 0032603adf8446cd9a59f26cc868400c (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:56:56.204180 30459 tablet_service.cc:1558] Processing DeleteTablet for tablet a35e1cb09e2146a084cf577b068e4140 with delete_type TABLET_DATA_TOMBSTONED (TS ef1ca7acf52a438f89f14707e9e06818 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33906
I20260807 07:56:56.205127 31566 tablet_replica.cc:333] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818: stopping tablet replica
I20260807 07:56:56.210335 31566 raft_consensus.cc:2243] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 07:56:56.211079 31566 raft_consensus.cc:2272] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 07:56:56.220336 31566 ts_tablet_manager.cc:1916] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:56:56.221875 31576 ts_tablet_manager.cc:1929] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 07:56:56.222282 31576 log.cc:1199] T 30057a01f5fa4baba4b3b02fe84a0f78 P f831a53ec51d452398015797d543164e: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root/wals/30057a01f5fa4baba4b3b02fe84a0f78
I20260807 07:56:56.223888 30203 catalog_manager.cc:5028] TS f831a53ec51d452398015797d543164e (127.27.64.131:33207): tablet 30057a01f5fa4baba4b3b02fe84a0f78 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:56:56.233999 31566 ts_tablet_manager.cc:1929] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260807 07:56:56.234365 31566 log.cc:1199] T a35e1cb09e2146a084cf577b068e4140 P ef1ca7acf52a438f89f14707e9e06818: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root/wals/a35e1cb09e2146a084cf577b068e4140
I20260807 07:56:56.235769 30201 catalog_manager.cc:5028] TS ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): tablet a35e1cb09e2146a084cf577b068e4140 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:56:57.279817 30489 consensus_queue.cc:237] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:56:57.286751 30430 consensus_peers.cc:597] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6acbd1341f44b138a96457c583930e4. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:57.286795 30586 raft_consensus.cc:1275] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:57.286988 30369 raft_consensus.cc:1275] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:57.288057 31564 consensus_queue.cc:1048] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:57.288929 31521 consensus_queue.cc:1048] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:57.296100 31564 raft_consensus.cc:2955] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.297638 30586 raft_consensus.cc:2955] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.298295 30369 raft_consensus.cc:2955] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.318585 30220 catalog_manager.cc:5697] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.334573 30369 consensus_queue.cc:237] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:57.352736 30586 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:57.354238 30489 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:57.354219 31433 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:57.355928 31453 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:57.362673 31433 raft_consensus.cc:2955] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.364300 30586 raft_consensus.cc:2955] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
W20260807 07:56:57.369864 30323 consensus_peers.cc:597] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d30d61dc67614c5c9d0f1083e2a463b9. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:57.375883 30488 raft_consensus.cc:2955] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.385433 30222 catalog_manager.cc:5697] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.391088 30478 consensus_queue.cc:237] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:56:57.409682 30430 consensus_peers.cc:597] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 39d207f188764d0caf032e77702cdc6b. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:57.410045 30586 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:57.411201 30369 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:57.412480 31564 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:57.413242 31521 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:57.422736 31579 raft_consensus.cc:2955] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.425701 30586 raft_consensus.cc:2955] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.425815 30365 raft_consensus.cc:2955] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.440392 30367 consensus_queue.cc:237] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:57.440905 30220 catalog_manager.cc:5697] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.463912 30586 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:57.465750 31601 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 07:56:57.471601 30323 consensus_peers.cc:597] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14880a591ef44360b5046f67cab3d4ad. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:56:57.478686 30478 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 07:56:57.487404 31433 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:56:57.492415 31433 raft_consensus.cc:2955] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.495827 30582 raft_consensus.cc:2955] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.502517 30478 raft_consensus.cc:2955] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:56:57.514158 30220 catalog_manager.cc:5697] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 2, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 1 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
W20260807 07:56:58.594138 30319 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s user 0.002s sys 0.008s
W20260807 07:56:58.594596 30319 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s user 0.002s sys 0.008s
I20260807 07:56:58.638036 31623 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:58.638916 31623 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:58.659077 31623 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:58.667934 31623 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:58.671767 31623 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:58.678169 31623 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:56:58.689582 30267 debug-util.cc:398] Leaking SignalData structure 0x7b0800042080 after lost signal to thread 27911
W20260807 07:56:58.690822 30267 debug-util.cc:398] Leaking SignalData structure 0x7b080017cbe0 after lost signal to thread 30272
W20260807 07:56:58.725723 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 1.06674e+06us
I20260807 07:56:58.731220 31618 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:56:58.731927 31618 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:58.782001 31622 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:58.782727 31622 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:58.785310 31622 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:58.881062 31622 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:56:58.881713 31622 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:58.883912 31622 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:58.924250 31618 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:59.016785 31618 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:59.017509 31618 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.019752 31618 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:59.020354 31618 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:56:58.948355 31548 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:59.021783 31548 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.023962 31548 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:59.024519 31548 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:59.025066 31548 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:58.972875 31624 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:59.026258 31624 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.027298 31548 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:58.965095 31564 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:59.028479 31624 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:58.963024 31620 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:59.029716 31622 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:56:59.020906 31618 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:59.042460 31625 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:59.060170 31453 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:59.060356 31615 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:59.061072 31619 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:59.067922 31579 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:56:59.080332 31623 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:59.132313 31638 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:59.142428 31626 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:59.143517 31628 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:59.144637 31630 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:56:59.147974 31453 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.145864 31564 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.145715 31622 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.149597 31625 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.151163 31623 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.145642 31620 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.155721 31628 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.416296 31564 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:59.220044 31464 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:59.421618 31464 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.283288 31453 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:59.332064 31651 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:56:59.153124 31548 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:59.355647 31643 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:59.417073 31638 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.417644 31433 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:59.354905 31640 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:59.397814 31647 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:56:59.153527 31619 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.418991 31620 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:59.150673 31579 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.155776 31626 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:56:59.426463 31464 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:59.587867 31464 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:56:59.588340 31464 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.488746 31433 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.423938 31548 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.395191 31641 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:59.340292 31618 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:59.417896 31627 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:56:59.417761 31625 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:59.424103 31643 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:56:59.658049 31433 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:59.355388 31624 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:56:59.416201 31623 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:59.776707 31647 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.819653 31626 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:56:59.328905 31608 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:56:59.872152 31464 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:59.397590 31629 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:59.332767 31632 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:00.408965 31464 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:00.509850 31464 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:56:59.594939 31620 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:00.109676 31627 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.719488 31628 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:56:59.804585 31618 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:59.327611 31637 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:00.082288 31625 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:56:59.375782 31639 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:00.677244 31464 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:00.483335 31626 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:56:59.220155 31615 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:00.909307 30429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.321s user 0.027s sys 0.032s
W20260807 07:57:00.909790 30429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.322s user 0.027s sys 0.033s
I20260807 07:56:59.341063 31630 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:00.168810 31624 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:56:59.424543 31651 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:00.988660 31667 ts_tablet_manager.cc:933] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:00.678661 31622 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:00.328984 31640 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:00.901315 31653 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:00.992451 31384 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.912s user 0.006s sys 0.012s
I20260807 07:57:00.630656 31620 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:00.703536 31618 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:00.081014 31641 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:00.902207 31625 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:01.058295 31384 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 1.197s user 0.006s sys 0.013s
I20260807 07:57:00.981968 31626 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:00.978150 31632 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:00.678087 31629 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:01.078354 30542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.488s user 0.014s sys 0.018s
W20260807 07:57:01.078819 30542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.488s user 0.014s sys 0.018s
I20260807 07:57:00.610276 31608 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.084064 31464 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:01.084570 31464 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.061673 31664 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.087625 31464 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:01.087710 31655 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:01.090189 31579 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.082309 31647 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.096654 31608 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.090312 31564 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:01.058389 31653 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.090788 31548 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:01.151257 31564 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:01.092845 31669 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.091187 31664 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:00.990247 31637 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.101631 31579 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:00.990413 31639 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.104490 31643 leader_election.cc:290] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.152994 31615 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.154215 31647 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.156981 31619 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.158723 31608 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:01.160146 31548 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.172441 31627 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.163705 31638 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.164714 31579 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.171787 31647 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.172600 31626 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.175433 31548 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.098673 31655 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:57:01.184495 30428 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.549s user 0.008s sys 0.025s
I20260807 07:57:01.174695 31667 tablet_copy_client.cc:323] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
W20260807 07:57:01.208479 30428 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.676s user 0.008s sys 0.030s
I20260807 07:57:01.180194 31627 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.179066 31651 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:01.173516 31608 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.165201 31669 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.193440 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:01.192209 31641 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:01.207911 31564 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:01.217504 31548 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:01.208345 31622 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.180897 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:01.209311 31668 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.210520 31659 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.209542 31630 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.220458 31622 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.212440 31632 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.218039 31564 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.213193 31627 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.229136 31564 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.229619 30503 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet a6acbd1341f44b138a96457c583930e4 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
I20260807 07:57:01.230172 30503 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet a6acbd1341f44b138a96457c583930e4 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-a6acbd1341f44b138a96457c583930e4
I20260807 07:57:01.208137 31671 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.214526 31653 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.223122 31668 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.231843 31671 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.228076 31629 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:01.244247 31637 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.232383 31622 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:01.233814 31659 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.246232 31639 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.250881 31608 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.266319 31659 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:01.278400 31627 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.279363 31668 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:01.280073 31671 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.284128 31640 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.286761 30503 tablet_copy_source_session.cc:215] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:01.299381 31651 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.302096 31651 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:57:01.302757 30319 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.156s user 0.011s sys 0.077s
I20260807 07:57:01.304090 31651 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:01.305527 31629 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:01.306018 31629 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.308683 31638 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.308861 31629 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:01.309245 31638 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.311233 31638 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.313352 31670 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.314190 31637 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.313943 31670 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.288440 31622 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:01.314437 31651 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.326116 31651 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.327136 31622 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.315145 31659 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.330551 31659 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.333994 31680 ts_tablet_manager.cc:933] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:01.323300 31637 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.337908 31637 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.341687 31667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6acbd1341f44b138a96457c583930e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:01.347285 31622 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:01.347934 30319 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.201s user 0.011s sys 0.077s
I20260807 07:57:01.351558 31640 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.352079 31640 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.356990 31615 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.357550 31615 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.370080 31637 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.370728 31637 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:01.373206 31655 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.378996 31632 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.379633 31632 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.384538 31618 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.388939 31625 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.409157 31686 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.409627 31624 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.409806 31686 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.411618 31619 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.411963 31686 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.412142 31619 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.412494 31686 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.416230 31619 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.418927 31619 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.419417 31619 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.420838 31619 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.422536 31638 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.422670 31619 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.423018 31638 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.423230 31619 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.424582 31637 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.425118 31638 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.425616 31619 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.426075 31632 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.423269 31615 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.426923 31615 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.427495 31638 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.427640 31615 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.428057 31638 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.430217 31638 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.427037 31632 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.430815 31638 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.430918 31632 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.431373 31638 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.432950 31632 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.430297 31615 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.433264 31638 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.428474 31637 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:01.523511 31637 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.510824 31619 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:01.563490 31619 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:01.566030 31640 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:01.566752 31338 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.27.64.129:36407 for RPC RequestConsensusVote timed out after 1.630s (ON_OUTBOUND_QUEUE) [suppressed 46 similar messages]
I20260807 07:57:01.587581 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:01.618093 31637 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.704787 31619 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:01.771176 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:01.773952 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:01.774712 30358 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:01.775652 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:01.776835 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:01.773896 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:01.778630 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:01.778818 30373 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:01.779359 30369 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:01.779945 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:01.780280 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:01.781392 30369 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:01.782102 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:01.786357 30365 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:01.781129 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:01.891425 30373 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
W20260807 07:57:02.572006 31680 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 1.236s user 0.019s sys 0.006s
I20260807 07:57:02.992398 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:02.559855 31686 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:03.010377 30369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45046 (request call id 678) took 1234 ms. Trace:
I20260807 07:57:03.147151 30373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45046 (request call id 679) took 1371 ms. Trace:
I20260807 07:57:03.147769 30373 rpcz_store.cc:276] 0807 07:57:01.775926 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:02.932979 (+1157053us) service_pool.cc:224] Handling call
0807 07:57:03.146644 (+213665us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:03.146824 (+ 180us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:03.146849 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:03.146889 (+ 40us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:03.146927 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:03.146978 (+ 51us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:03.147083 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:57:03.263046 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:03.263893 30373 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:03.264875 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:03.266338 30373 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:03.268213 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:03.271267 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:03.268313 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:03.275061 30365 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
W20260807 07:57:03.298218 31667 consensus_meta.cc:287] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent flushing consensus metadata: real 1.528s user 0.008s sys 0.000s
I20260807 07:57:03.299772 31667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59392 (request call id 28) took 3875 ms. Trace:
I20260807 07:57:03.107092 30369 rpcz_store.cc:276] 0807 07:57:01.775661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:02.933449 (+1157788us) service_pool.cc:224] Handling call
0807 07:57:03.009824 (+ 76375us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:03.010023 (+ 199us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:03.010057 (+ 34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:03.010102 (+ 45us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:03.010131 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:03.010183 (+ 52us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:03.010303 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:57:03.274503 30373 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:03.363648 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:03.363708 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:03.363823 31667 rpcz_store.cc:276] 0807 07:56:59.424490 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:56:59.462229 (+ 37739us) service_pool.cc:224] Handling call
0807 07:57:00.989114 (+1526885us) ts_tablet_manager.cc:934] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
0807 07:57:01.339867 (+350753us) tablet_copy_client.cc:368] Tablet copy session begun
0807 07:57:01.770089 (+430222us) tablet_metadata.cc:665] Metadata flushed
0807 07:57:01.770240 (+ 151us) tablet_copy_client.cc:497] Wrote new tablet metadata
0807 07:57:03.298858 (+1528618us) tablet_copy_client.cc:418] Wrote new consensus metadata
0807 07:57:03.299236 (+ 378us) tablet_replica.cc:206] Creating consensus instance
0807 07:57:03.299594 (+ 358us) ts_tablet_manager.cc:989] Replica registered.
0807 07:57:03.299676 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":23679,"tablet-copy.queue_time_us":1334392,"thread_start_us":1307190,"threads_started":2}
I20260807 07:57:03.378021 31667 tablet_copy_client.cc:806] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:03.378727 31667 tablet_copy_client.cc:670] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:03.380288 31686 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:03.132323 31680 tablet_copy_client.cc:323] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:57:03.372938 30365 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:03.372879 30373 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:03.389784 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:03.623135 31673 negotiation.cc:336] Failed RPC negotiation. Trace:
0807 07:57:00.610469 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.27.64.129:36407 (local address 127.0.0.1:33334)
0807 07:57:01.178485 (+568016us) negotiation.cc:107] Waiting for socket to connect
0807 07:57:01.178570 (+ 85us) client_negotiation.cc:175] Beginning negotiation
0807 07:57:01.203949 (+ 25379us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0807 07:57:03.622022 (+2418073us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.27.64.129:36407: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":455670,"thread_start_us":407638,"threads_started":1}
I20260807 07:57:03.729203 30366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45046 (request call id 674) took 1954 ms. Trace:
I20260807 07:57:03.729866 30366 rpcz_store.cc:276] 0807 07:57:01.774500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:03.728087 (+1953587us) service_pool.cc:224] Handling call
0807 07:57:03.728520 (+ 433us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:03.728730 (+ 210us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:03.728758 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:03.728802 (+ 44us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:03.728837 (+ 35us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:03.728895 (+ 58us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:03.729030 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:57:03.819382 31659 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:03.846382 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 403125us
I20260807 07:57:03.861706 31670 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:03.868714 31651 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:03.873366 31669 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:03.905946 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 51025.1us
W20260807 07:57:03.919400 30323 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.859s user 0.031s sys 0.061s
W20260807 07:57:03.920095 30323 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.860s user 0.032s sys 0.062s
I20260807 07:57:03.924649 30367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45046 (request call id 650) took 2574 ms. Trace:
I20260807 07:57:03.924559 31693 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:03.927130 31695 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:03.929207 30367 rpcz_store.cc:276] 0807 07:57:01.349926 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:03.922522 (+2572596us) service_pool.cc:224] Handling call
0807 07:57:03.923293 (+ 771us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:03.923816 (+ 523us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:03.923952 (+ 136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:03.924086 (+ 134us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:03.924148 (+ 62us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:03.924264 (+ 116us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:03.924391 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:57:03.929797 31695 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:03.931576 30363 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45046 (request call id 673) took 2157 ms (client timeout 1788 ms). Trace:
W20260807 07:57:03.932124 30363 rpcz_store.cc:269] 0807 07:57:01.774224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:03.931139 (+2156915us) service_pool.cc:211] Skipping call since client already timed out
0807 07:57:03.931317 (+ 178us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260807 07:57:03.932834 31695 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:03.933570 31695 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:03.934314 31695 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:03.928385 31696 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:03.937170 31695 leader_election.cc:290] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:03.937907 31696 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:03.940246 31696 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:03.940579 30428 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.729s user 0.021s sys 0.033s
W20260807 07:57:03.941089 30428 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.730s user 0.022s sys 0.034s
I20260807 07:57:03.941672 31693 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:03.945060 31693 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:03.958532 31669 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:03.968097 31669 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:03.969264 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:03.970461 30488 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:03.970577 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:03.970890 31669 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:03.971478 31669 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:03.971478 30478 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:03.972412 31669 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:03.974491 31669 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:03.992638 30372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45046 (request call id 670) took 2219 ms. Trace:
I20260807 07:57:03.992935 30364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45046 (request call id 653) took 2642 ms. Trace:
I20260807 07:57:03.993197 30372 rpcz_store.cc:276] 0807 07:57:01.773272 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:03.991188 (+2217916us) service_pool.cc:224] Handling call
0807 07:57:03.991722 (+ 534us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:03.992109 (+ 387us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:03.992141 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:03.992216 (+ 75us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:03.992251 (+ 35us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:03.992316 (+ 65us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:03.992449 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:57:03.993476 30364 rpcz_store.cc:276] 0807 07:57:01.350679 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:03.991519 (+2640840us) service_pool.cc:224] Handling call
0807 07:57:03.992093 (+ 574us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:03.992450 (+ 357us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:03.992485 (+ 35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:03.992547 (+ 62us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:03.992579 (+ 32us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:03.992642 (+ 63us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:03.992758 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260807 07:57:04.000674 31697 negotiation.cc:336] Failed RPC negotiation. Trace:
0807 07:57:03.994760 (+ 0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:33334 (local address 127.27.64.129:36407)
0807 07:57:03.997653 (+ 2893us) server_negotiation.cc:207] Beginning negotiation
0807 07:57:03.997708 (+ 55us) server_negotiation.cc:400] Waiting for connection header
0807 07:57:03.997807 (+ 99us) server_negotiation.cc:408] Connection header received
0807 07:57:03.998203 (+ 396us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0807 07:57:03.998236 (+ 33us) server_negotiation.cc:462] Received NEGOTIATE request from client
0807 07:57:03.998633 (+ 397us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0807 07:57:03.999225 (+ 592us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33334: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":1911,"thread_start_us":2676,"threads_started":1}
W20260807 07:57:04.014277 30267 debug-util.cc:398] Leaking SignalData structure 0x7b0800318240 after lost signal to thread 30521
W20260807 07:57:04.016361 30267 debug-util.cc:398] Leaking SignalData structure 0x7b080030e080 after lost signal to thread 30627
I20260807 07:57:04.018208 31616 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.018235 31622 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.019586 31616 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.020998 31622 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.023102 31616 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.023509 31622 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:04.030920 30267 debug-util.cc:398] Leaking SignalData structure 0x7b08003071e0 after lost signal to thread 31418
W20260807 07:57:04.052168 31338 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.484s user 0.017s sys 0.014s
W20260807 07:57:04.052795 31338 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.485s user 0.018s sys 0.016s
I20260807 07:57:04.059099 31698 ts_tablet_manager.cc:933] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.060077 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.062196 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.062685 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.064217 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.064442 31647 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.065019 30367 raft_consensus.cc:2468] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
W20260807 07:57:04.053248 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 2.53247e+06us
I20260807 07:57:04.072981 31622 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:04.077870 31661 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:04.078214 31622 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:04.078631 31681 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.074361 31651 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:04.079439 31681 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.079552 31651 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.077157 31684 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.081936 31684 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.088182 31659 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:04.088954 31659 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.102415 31680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59320 (request call id 2) took 3093 ms. Trace:
I20260807 07:57:04.102887 31680 rpcz_store.cc:276] 0807 07:57:01.027341 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:01.081065 (+ 53724us) service_pool.cc:224] Handling call
0807 07:57:01.334336 (+253271us) ts_tablet_manager.cc:934] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
0807 07:57:04.102129 (+2767793us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":116199,"tablet-copy.queue_time_us":158236,"thread_start_us":1741644,"threads_started":2}
I20260807 07:57:04.105835 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.107963 31670 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.108701 31670 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.110926 31682 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.111701 31682 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.114308 31616 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.115104 31616 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.117619 31661 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:04.118230 31548 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:04.118939 31548 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.121976 31681 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.129882 31620 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.130859 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.135109 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.135982 31695 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.142448 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.143024 31695 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:04.146054 30358 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45046 (request call id 680) took 2369 ms (client timeout 1768 ms). Trace:
I20260807 07:57:04.138687 31620 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:04.145254 31695 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.128886 31681 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:04.159543 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.157816 31579 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.163175 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.165158 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.165436 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.154997 31620 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.166385 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.156172 31647 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.167838 31620 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.167698 31647 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.168617 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.169764 31647 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:04.149753 30358 rpcz_store.cc:269] 0807 07:57:01.776205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:01.778371 (+ 2166us) service_pool.cc:224] Handling call
0807 07:57:04.134704 (+2356333us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b58001b0c98. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b884c 00007fd6b21b840b 00007fd6bb124219 00007fd6ba277640 00007fd6ba33febb 00007fd6ba33ff41 00007fd6ba2edeb0 00007fd6ba2ed794 00007fd6b3836834 00007fd6b38367c2
0807 07:57:04.145936 (+ 11232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112283904}
I20260807 07:57:04.171070 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.172287 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.158988 31681 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.174108 31681 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.178718 31698 tablet_copy_client.cc:323] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
W20260807 07:57:04.160470 31338 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletCopyService.BeginTabletCopySession -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 51674.9us
W20260807 07:57:04.180207 30402 debug-util.cc:398] Leaking SignalData structure 0x7b08001b0e60 after lost signal to thread 27911
I20260807 07:57:04.194133 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:04.195454 31338 leader_election.cc:336] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Timed out: Client connection negotiation failed: client connection to 127.27.64.129:36407: received 0 of 4 requested bytes
W20260807 07:57:04.197540 31338 connection.cc:256] RPC call timeout handler was delayed by -1.4675022070296109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260807 07:57:04.197922 31338 connection.cc:256] RPC call timeout handler was delayed by -1.0788240770343691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
I20260807 07:57:04.180723 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.199064 31684 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.181475 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.199934 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.185727 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:04.187739 30541 connection.cc:256] RPC call timeout handler was delayed by -3.4801570852287114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
I20260807 07:57:04.192376 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.198520 31608 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:04.205832 30541 connection.cc:256] RPC call timeout handler was delayed by -3.2012540439609438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260807 07:57:04.205874 30367 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
W20260807 07:57:04.206259 30541 connection.cc:256] RPC call timeout handler was delayed by -3.1669411088805646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260807 07:57:04.206557 30541 connection.cc:256] RPC call timeout handler was delayed by -3.1420139470137656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
W20260807 07:57:04.206952 30541 connection.cc:256] RPC call timeout handler was delayed by -3.0817139470018446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260807 07:57:04.207255 30541 connection.cc:256] RPC call timeout handler was delayed by -2.9656139470171183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
I20260807 07:57:04.208411 31702 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:04.208667 30402 debug-util.cc:398] Leaking SignalData structure 0x7b08001be8a0 after lost signal to thread 30272
I20260807 07:57:04.209213 31702 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.209918 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.210798 30363 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:04.211666 31702 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.212064 31622 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.212455 31548 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.213027 31702 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.213853 31702 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:04.214149 31664 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.215956 31684 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.217180 31684 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.218195 31682 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.219357 31684 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.219941 31651 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.221879 31564 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:04.224083 30360 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45046 (request call id 672) took 2450 ms (client timeout 1663 ms). Trace:
W20260807 07:57:04.224530 30360 rpcz_store.cc:269] 0807 07:57:01.773893 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:04.223741 (+2449848us) service_pool.cc:211] Skipping call since client already timed out
0807 07:57:04.223903 (+ 162us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260807 07:57:04.226075 30402 debug-util.cc:398] Leaking SignalData structure 0x7b08003133a0 after lost signal to thread 30407
I20260807 07:57:04.230592 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.230955 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:04.231817 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.233150 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:04.233913 31385 raft_consensus.cc:2468] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.237877 31704 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:04.238747 31704 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.240329 31616 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.231745 31384 raft_consensus.cc:2468] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
W20260807 07:57:04.243852 30402 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad920 after lost signal to thread 30521
W20260807 07:57:04.245297 30402 debug-util.cc:398] Leaking SignalData structure 0x7b08002ae3c0 after lost signal to thread 30627
I20260807 07:57:04.243595 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:04.246748 30502 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet 39d207f188764d0caf032e77702cdc6b from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
W20260807 07:57:04.246353 30402 debug-util.cc:398] Leaking SignalData structure 0x7b08002ae280 after lost signal to thread 30628
I20260807 07:57:04.248936 31667 tablet_copy_client.cc:538] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:04.250819 31608 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.247553 30502 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet 39d207f188764d0caf032e77702cdc6b from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-39d207f188764d0caf032e77702cdc6b
I20260807 07:57:04.253965 31680 ts_tablet_manager.cc:933] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:04.254235 31661 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.254235 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.256098 30542 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:57:04.256910 30402 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2ba0 after lost signal to thread 31418
I20260807 07:57:04.257210 31661 raft_consensus.cc:2804] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.248811 31659 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.257777 31661 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.258200 31661 raft_consensus.cc:3060] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.257254 31670 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.273897 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.274864 31608 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.278251 31704 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.283535 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.285207 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.286103 30488 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:04.287240 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.288587 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.290086 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.291015 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.293128 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.293412 30488 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.294549 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.295923 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.295437 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.291996 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.300776 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.301054 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.300786 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.302093 31702 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:04.310092 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.311131 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.313398 30480 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:04.312165 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.314803 31667 tablet_bootstrap.cc:492] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
W20260807 07:57:04.299872 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 53814.5us
I20260807 07:57:04.320386 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.315656 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.312968 30502 tablet_copy_source_session.cc:215] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:04.329526 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.329763 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.333570 30541 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:04.334121 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.334656 30541 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:04.335695 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.336411 30541 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:04.336995 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.319916 31661 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:04.313011 30477 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:04.337512 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.338039 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.343091 31659 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.343497 31659 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.343875 31659 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:04.339016 30429 connection.cc:256] RPC call timeout handler was delayed by -1.8134298750665039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
I20260807 07:57:04.339880 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:04.345296 30429 connection.cc:256] RPC call timeout handler was delayed by -1.8134298750665039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260807 07:57:04.345824 30429 connection.cc:256] RPC call timeout handler was delayed by -1.7864298750646412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260807 07:57:04.346433 30429 connection.cc:256] RPC call timeout handler was delayed by -1.7864298750646412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
W20260807 07:57:04.346805 30429 connection.cc:256] RPC call timeout handler was delayed by -1.7203944029752165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260807 07:57:04.347143 30429 connection.cc:256] RPC call timeout handler was delayed by -1.7203944029752165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260807 07:57:04.352133 30429 connection.cc:256] RPC call timeout handler was delayed by -1.6919298749417067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
I20260807 07:57:04.352802 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.353436 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.348620 31704 raft_consensus.cc:2804] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.350018 31616 raft_consensus.cc:2804] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.355577 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.361121 31704 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.362761 31704 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.362929 31616 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.348402 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.362470 30373 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:04.347347 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.357842 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:04.358242 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.359649 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:04.360224 30429 connection.cc:256] RPC call timeout handler was delayed by -1.6919298749417067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
I20260807 07:57:04.349807 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.351078 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.364081 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.367836 30363 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:04.363397 31616 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.336440 30480 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
W20260807 07:57:04.370533 30429 connection.cc:256] RPC call timeout handler was delayed by -1.6676298750098795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260807 07:57:04.369591 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.370761 30490 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:04.356714 31661 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:04.363389 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.376811 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:04.382112 30323 consensus_peers.cc:576] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Unable to start Tablet Copy on peer: error { code: UNKNOWN_ERROR status { code: TIMED_OUT message: "unable to begin tablet copy session: Client connection negotiation failed: client connection to 127.27.64.129:36407: received 0 of 4 requested bytes" } }
I20260807 07:57:04.382294 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.367349 31680 tablet_copy_client.cc:323] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:57:04.378428 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.379694 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:04.384501 30429 connection.cc:256] RPC call timeout handler was delayed by -1.6676298750098795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260807 07:57:04.386646 30541 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:57:04.377745 30317 connection.cc:256] RPC call timeout handler was delayed by -3.7924109259620309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
I20260807 07:57:04.387809 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:04.388588 30429 connection.cc:256] RPC call timeout handler was delayed by -1.6456944029778242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260807 07:57:04.388832 30317 connection.cc:256] RPC call timeout handler was delayed by -3.5809109259862453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
I20260807 07:57:04.389607 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.389928 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.390630 31670 raft_consensus.cc:2804] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.391687 31670 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.390983 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.391790 31698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39d207f188764d0caf032e77702cdc6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:04.392623 30541 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:04.389544 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.392189 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:04.389075 30429 connection.cc:256] RPC call timeout handler was delayed by -1.6456944029778242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260807 07:57:04.394343 30429 connection.cc:256] RPC call timeout handler was delayed by -1.60069440305233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260807 07:57:04.394644 30429 connection.cc:256] RPC call timeout handler was delayed by -1.5871944029349834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260807 07:57:04.394917 30429 connection.cc:256] RPC call timeout handler was delayed by -1.5871944029349834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260807 07:57:04.395187 30429 connection.cc:256] RPC call timeout handler was delayed by -1.5731298751197755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260807 07:57:04.395462 30429 connection.cc:256] RPC call timeout handler was delayed by -1.5731298751197755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260807 07:57:04.395740 30429 connection.cc:256] RPC call timeout handler was delayed by -1.5551298749633133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260807 07:57:04.396013 30429 connection.cc:256] RPC call timeout handler was delayed by -1.5551298749633133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260807 07:57:04.396279 30429 connection.cc:256] RPC call timeout handler was delayed by -1.5236298749223351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260807 07:57:04.396540 30429 connection.cc:256] RPC call timeout handler was delayed by -1.5236298749223351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260807 07:57:04.396816 30429 connection.cc:256] RPC call timeout handler was delayed by -1.4359944029711187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260807 07:57:04.397084 30429 connection.cc:256] RPC call timeout handler was delayed by -1.4359944029711187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
I20260807 07:57:04.398119 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:04.397351 30429 connection.cc:256] RPC call timeout handler was delayed by -1.4264298749621958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260807 07:57:04.399044 30429 connection.cc:256] RPC call timeout handler was delayed by -1.4264298749621958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
I20260807 07:57:04.399756 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.400192 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.400844 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:04.399346 30429 connection.cc:256] RPC call timeout handler was delayed by -1.4237298751249909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260807 07:57:04.401926 30429 connection.cc:256] RPC call timeout handler was delayed by -1.4237298751249909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
I20260807 07:57:04.402880 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.403435 30490 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.404891 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.392151 31670 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:04.402303 30429 connection.cc:256] RPC call timeout handler was delayed by -1.3873944028746337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
I20260807 07:57:04.410547 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:04.410778 30429 connection.cc:256] RPC call timeout handler was delayed by -1.3873944028746337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260807 07:57:04.411118 30429 connection.cc:256] RPC call timeout handler was delayed by -1.3778337971307337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260807 07:57:04.411406 30429 connection.cc:256] RPC call timeout handler was delayed by -1.3729850961826742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260807 07:57:04.411692 30429 connection.cc:256] RPC call timeout handler was delayed by -1.367594402981922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260807 07:57:04.413439 30429 connection.cc:256] RPC call timeout handler was delayed by -1.367594402981922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
I20260807 07:57:04.414229 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.406723 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.425563 30482 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.426218 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.426570 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.427479 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.427945 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.428201 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.429157 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.429813 30487 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.414932 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.417964 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.419246 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.419864 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.421213 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.422140 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:04.382551 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 148709us
I20260807 07:57:04.380786 31659 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:04.423735 30429 connection.cc:256] RPC call timeout handler was delayed by -1.3369944030418992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260807 07:57:04.433529 30582 raft_consensus.cc:2393] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
W20260807 07:57:04.434582 30429 connection.cc:256] RPC call timeout handler was delayed by -1.3351944028399885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
W20260807 07:57:04.435257 30429 connection.cc:256] RPC call timeout handler was delayed by -1.3351944028399885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
W20260807 07:57:04.435642 30429 connection.cc:256] RPC call timeout handler was delayed by -1.294129875022918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
I20260807 07:57:04.437357 30323 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
I20260807 07:57:04.428156 30480 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.438212 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:04.418018 31704 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.429402 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.439603 31659 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:04.440665 30429 connection.cc:256] RPC call timeout handler was delayed by -1.2937944028526545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
I20260807 07:57:04.440670 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:04.482795 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 58381.1us
W20260807 07:57:04.482966 30429 connection.cc:256] RPC call timeout handler was delayed by -1.2937944028526545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260807 07:57:04.486325 30429 connection.cc:256] RPC call timeout handler was delayed by -1.2743298751302063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
I20260807 07:57:04.454885 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:04.470717 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:04.489288 30429 connection.cc:256] RPC call timeout handler was delayed by -1.2743298751302063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
W20260807 07:57:04.490320 30429 connection.cc:256] RPC call timeout handler was delayed by -1.2599337971769273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
W20260807 07:57:04.490700 30429 connection.cc:256] RPC call timeout handler was delayed by -1.2550850962288678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260807 07:57:04.469681 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:04.491099 30429 connection.cc:256] RPC call timeout handler was delayed by -1.252729875035584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
W20260807 07:57:04.491629 30429 connection.cc:256] RPC call timeout handler was delayed by -1.2203298751264811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260807 07:57:04.491973 30429 connection.cc:256] RPC call timeout handler was delayed by -1.2136944029480219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
I20260807 07:57:04.441310 31682 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.453400 31706 raft_consensus.cc:2804] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 07:57:04.492880 30429 connection.cc:256] RPC call timeout handler was delayed by -1.2050337970722467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
I20260807 07:57:04.485695 30386 tablet_copy_service.cc:140] P b1188d7d3a0b455894bc443d571f6a19: Received BeginTabletCopySession request for tablet d30d61dc67614c5c9d0f1083e2a463b9 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:33338)
I20260807 07:57:04.496335 31704 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.496733 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:04.494896 30429 connection.cc:256] RPC call timeout handler was delayed by -1.1614944029133767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
I20260807 07:57:04.498082 31711 ts_tablet_manager.cc:933] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:04.486076 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:04.499066 30429 connection.cc:256] RPC call timeout handler was delayed by -1.1614944029133767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
W20260807 07:57:04.499874 30429 connection.cc:256] RPC call timeout handler was delayed by -1.1582337971776724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260807 07:57:04.500118 30429 connection.cc:256] RPC call timeout handler was delayed by -1.139894403051585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260807 07:57:04.500315 30429 connection.cc:256] RPC call timeout handler was delayed by -1.1254944030661136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
I20260807 07:57:04.498823 30541 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:57:04.501111 30429 connection.cc:256] RPC call timeout handler was delayed by -1.1254944030661136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260807 07:57:04.501596 30429 connection.cc:256] RPC call timeout handler was delayed by -1.1254944030661136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260807 07:57:04.501957 30429 connection.cc:256] RPC call timeout handler was delayed by -1.1231337969657034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260807 07:57:04.502286 30429 connection.cc:256] RPC call timeout handler was delayed by -1.1129991379566491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260807 07:57:04.502537 30429 connection.cc:256] RPC call timeout handler was delayed by -1.0957944029942155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260807 07:57:04.483779 31616 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.496225 30386 tablet_copy_service.cc:161] P b1188d7d3a0b455894bc443d571f6a19: Beginning new tablet copy session on tablet d30d61dc67614c5c9d0f1083e2a463b9 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:33338: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-d30d61dc67614c5c9d0f1083e2a463b9
I20260807 07:57:04.512537 31616 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.508587 31684 raft_consensus.cc:2804] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.508930 30539 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:04.523304 31684 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.526733 31684 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.494949 31682 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.530232 31704 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.530700 31704 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:04.531087 31704 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.532418 30539 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:04.533106 30317 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.534181 31702 raft_consensus.cc:2804] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.534538 31702 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.534873 31702 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.494776 31706 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.537528 30317 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.532401 31682 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.543356 31616 raft_consensus.cc:2749] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:04.545805 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.554868 31695 raft_consensus.cc:2804] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.555281 31695 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.555635 31695 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.558689 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.560611 30541 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:04.560997 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.563311 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.567229 30317 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.556838 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.538654 31706 raft_consensus.cc:3060] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:04.582137 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 54048us
I20260807 07:57:04.583279 31616 raft_consensus.cc:2804] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.583783 31616 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.584228 31616 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.587327 30541 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:04.590102 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.590389 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.591104 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.591827 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:04.592356 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:04.539872 31711 tablet_copy_client.cc:323] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:57:04.596328 31184 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.597764 31184 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.598132 31184 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.599956 30429 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.600797 31620 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.601166 31620 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.601560 31620 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.609208 31696 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.610656 31184 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:04.603431 30385 tablet_copy_service.cc:140] P b1188d7d3a0b455894bc443d571f6a19: Received BeginTabletCopySession request for tablet 14880a591ef44360b5046f67cab3d4ad from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:33338)
I20260807 07:57:04.611846 31696 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.616182 31704 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.616598 31616 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.623679 30539 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:04.619391 30541 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:04.620507 30385 tablet_copy_service.cc:161] P b1188d7d3a0b455894bc443d571f6a19: Beginning new tablet copy session on tablet 14880a591ef44360b5046f67cab3d4ad from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:33338: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-14880a591ef44360b5046f67cab3d4ad
I20260807 07:57:04.620893 31696 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.625801 31184 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.586905 31684 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.633653 31622 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.631204 31670 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:04.635502 31696 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.636533 31684 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.636662 31670 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.634987 30386 tablet_copy_source_session.cc:215] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:04.634383 30429 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.638845 30541 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:04.634109 31622 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:04.650755 31622 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.651629 31647 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.651830 30429 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.652072 31647 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.652480 31647 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.652647 31666 raft_consensus.cc:2804] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.640115 30539 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:04.646854 31698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59392 (request call id 29) took 5051 ms. Trace:
I20260807 07:57:04.653069 31666 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.643043 31682 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.654364 31184 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.656541 31184 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.656819 31184 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.657742 31705 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:04.660490 31702 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.654975 31666 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.659451 31705 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.664629 31705 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.665630 31705 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.663910 30539 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:04.670641 30385 tablet_copy_source_session.cc:215] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:04.674896 31675 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.675282 31675 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:04.676314 31675 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.675802 31184 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.675815 30429 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.681592 31184 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.681981 31704 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.687412 30429 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.686408 30317 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.678074 31616 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.676100 31696 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.679963 31608 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.691874 31711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14880a591ef44360b5046f67cab3d4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:04.691635 31666 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.691851 31675 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.692721 31702 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.693537 30539 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:04.697317 31664 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.698451 31601 raft_consensus.cc:2804] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.701104 31680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d30d61dc67614c5c9d0f1083e2a463b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:04.694619 31608 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.720528 31601 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.720839 31608 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.720983 31601 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.721190 31664 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.704861 31675 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.685879 31695 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.706190 31667 tablet_bootstrap.cc:492] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:04.711869 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.712399 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.712690 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.726351 31667 tablet_bootstrap.cc:492] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:04.726567 30578 raft_consensus.cc:2468] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.726897 31695 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.713497 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.727681 30579 raft_consensus.cc:2393] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:04.714229 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.721688 31664 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.715967 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.717499 31705 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.717988 31706 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:04.720950 30539 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:04.719707 30429 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.723294 31670 raft_consensus.cc:2804] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.713364 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.727082 31667 ts_tablet_manager.cc:1403] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.413s user 0.015s sys 0.015s
I20260807 07:57:04.735353 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.730504 31682 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.736912 30582 raft_consensus.cc:2393] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:04.735452 31670 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:04.737884 31670 raft_consensus.cc:3060] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.739307 30539 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:04.740470 30317 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.745409 30539 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:04.743757 31696 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.748627 31696 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.749266 31696 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.750327 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:04.750787 31706 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:04.742784 31564 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.753693 31564 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.754070 31564 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.743760 30363 raft_consensus.cc:2393] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:04.654151 31698 rpcz_store.cc:276] 0807 07:56:59.861420 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:04.046649 (+4185229us) service_pool.cc:224] Handling call
0807 07:57:04.059466 (+ 12817us) ts_tablet_manager.cc:934] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
0807 07:57:04.388117 (+328651us) tablet_copy_client.cc:368] Tablet copy session begun
0807 07:57:04.471731 (+ 83614us) tablet_metadata.cc:665] Metadata flushed
0807 07:57:04.471857 (+ 126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0807 07:57:04.645963 (+174106us) tablet_copy_client.cc:418] Wrote new consensus metadata
0807 07:57:04.646341 (+ 378us) tablet_replica.cc:206] Creating consensus instance
0807 07:57:04.646715 (+ 374us) ts_tablet_manager.cc:989] Replica registered.
0807 07:57:04.646780 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":3129,"tablet-copy.queue_time_us":11234,"thread_start_us":114861,"threads_started":2}
I20260807 07:57:04.758225 31698 tablet_copy_client.cc:806] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:04.758472 30539 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:04.750386 31620 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.743757 31616 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:04.761250 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.762048 31704 raft_consensus.cc:2749] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:04.763258 30587 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.759473 31682 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:04.759050 31698 tablet_copy_client.cc:670] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:04.775074 30317 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.774381 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.756839 31670 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.761240 31338 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:04.743234 31675 raft_consensus.cc:2749] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:04.764806 30539 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:04.747666 31667 raft_consensus.cc:359] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:04.771001 31620 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.776034 30582 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.778936 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.779531 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.773267 31664 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.791324 30587 raft_consensus.cc:2393] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:04.791462 31666 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.791734 30539 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:04.792526 31647 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.793361 30539 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:04.780048 31667 raft_consensus.cc:740] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
W20260807 07:57:04.802215 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 58711us
I20260807 07:57:04.804728 31715 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.805200 31682 raft_consensus.cc:2749] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:04.810061 30317 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.794468 31647 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.774534 31608 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.814906 31601 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.816984 31698 tablet_copy_client.cc:538] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:04.793596 31704 raft_consensus.cc:2749] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:04.797199 31675 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:04.813086 31702 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.824358 30587 raft_consensus.cc:1240] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:04.824657 31705 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.831990 30539 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:04.832458 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.832707 31184 raft_consensus.cc:2749] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:04.824747 31664 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.833200 30582 raft_consensus.cc:2393] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:04.833678 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.834115 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.813303 31715 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.834708 31715 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.834844 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.826205 30317 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:04.830826 31702 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.839511 30539 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:04.834694 30588 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.841789 31184 raft_consensus.cc:2749] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:04.856220 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.834370 30578 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.858878 30582 raft_consensus.cc:2393] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:04.849048 31702 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.835188 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.863850 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.864447 30581 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.865443 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.866724 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.867274 30588 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.872115 31564 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.874437 31670 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:04.858894 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.876114 30584 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.878239 31721 raft_consensus.cc:3060] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.882637 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.886960 30429 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:04.860661 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 99496.6us
I20260807 07:57:04.825525 31667 consensus_queue.cc:260] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:04.890172 31601 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.902750 31666 raft_consensus.cc:2804] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.876210 31696 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.911937 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.894172 31622 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.914228 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.912305 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.911965 31666 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.935554 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.944070 30585 raft_consensus.cc:1240] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
W20260807 07:57:04.945185 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 119048us
I20260807 07:57:04.943368 30586 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.954090 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:04.942672 31666 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:04.969247 31695 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:04.969825 31695 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.971084 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.973866 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.974781 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.975322 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.975895 30588 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:04.976979 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.959116 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.977802 30590 raft_consensus.cc:2393] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:04.978874 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:04.979892 30581 raft_consensus.cc:2393] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:04.984553 31666 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:04.987305 31711 tablet_copy_client.cc:806] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:04.988013 31711 tablet_copy_client.cc:670] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:04.959291 31564 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.967265 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:04.989529 31729 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:04.959120 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:04.991125 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:04.967794 30587 raft_consensus.cc:2393] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:04.956830 31608 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:04.932390 31338 leader_election.cc:304] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:05.011763 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:04.974802 30578 raft_consensus.cc:2393] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:05.011668 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:04.990334 31729 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:04.993544 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.032229 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.032833 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.033632 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.034198 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.034852 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.034765 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.036005 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.035560 30479 raft_consensus.cc:1240] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.038467 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.054944 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.058248 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.063951 31695 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:05.029260 31729 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:05.074048 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 184879us
I20260807 07:57:05.084569 31736 raft_consensus.cc:2749] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.045013 31666 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:05.098047 31382 raft_consensus.cc:1217] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 07:57:05.101524 30480 raft_consensus.cc:1240] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.108206 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.126982 31729 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.127338 31601 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:05.128607 31601 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.139680 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.140890 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.142050 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.142731 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.142041 30582 raft_consensus.cc:2468] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:05.146138 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.145188 31702 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.146907 30586 raft_consensus.cc:2393] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:05.143527 30587 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:05.149442 31667 ts_tablet_manager.cc:1434] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.410s user 0.008s sys 0.015s
I20260807 07:57:05.150736 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.151537 30581 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:05.153529 30502 tablet_copy_service.cc:342] P ef1ca7acf52a438f89f14707e9e06818: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-a6acbd1341f44b138a96457c583930e4 received from {username='slave'} at 127.0.0.1:34358
I20260807 07:57:05.154196 30502 tablet_copy_service.cc:434] P ef1ca7acf52a438f89f14707e9e06818: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-a6acbd1341f44b138a96457c583930e4 on tablet a6acbd1341f44b138a96457c583930e4 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:05.161451 31696 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:05.146473 31622 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:05.164718 31680 tablet_copy_client.cc:806] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:05.165861 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.166074 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.166724 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.168102 30478 raft_consensus.cc:1240] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.168870 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.171437 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.171757 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.174961 30482 raft_consensus.cc:1240] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.175271 30581 raft_consensus.cc:2393] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:05.173753 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.177000 31698 tablet_bootstrap.cc:492] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:05.179935 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.180035 30477 raft_consensus.cc:1240] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.182734 31702 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:05.182925 30480 raft_consensus.cc:1240] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.166805 30578 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:05.201257 30478 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.186741 31601 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:05.203094 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 276758us
I20260807 07:57:05.204183 31338 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:05.188460 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.205410 31736 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.205665 30585 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:05.189260 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.206540 30581 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:05.190358 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.190855 31622 consensus_queue.cc:1059] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:05.191262 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.189441 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.191975 31721 raft_consensus.cc:2749] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.172400 31680 tablet_copy_client.cc:670] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:05.209024 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:05.210628 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 124599us
W20260807 07:57:05.211808 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 89186.7us
I20260807 07:57:05.210765 30587 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:05.222157 31384 raft_consensus.cc:1240] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.213073 31616 consensus_queue.cc:1059] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260807 07:57:05.217171 31675 consensus_queue.cc:1059] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260807 07:57:05.227121 31675 raft_consensus.cc:3055] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.260718 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.261062 31729 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:05.261662 30364 raft_consensus.cc:2393] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:05.213982 31715 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.234972 30586 raft_consensus.cc:1240] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.219218 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.227555 31684 consensus_queue.cc:1059] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260807 07:57:05.265872 31684 raft_consensus.cc:3055] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.240633 30317 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:05.266461 31684 raft_consensus.cc:740] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:05.267926 31684 consensus_queue.cc:260] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.225822 31616 raft_consensus.cc:3055] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.269558 31616 raft_consensus.cc:740] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:05.254925 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.270882 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.256577 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.271612 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.272276 30587 raft_consensus.cc:2393] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:05.258255 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.273178 30365 raft_consensus.cc:2393] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:05.273291 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.273824 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.274168 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.275070 31735 consensus_queue.cc:1059] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:05.275557 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.276818 31734 raft_consensus.cc:3055] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.277503 31734 raft_consensus.cc:740] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:05.278841 31734 consensus_queue.cc:260] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:05.276623 31702 raft_consensus.cc:2749] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.261617 31338 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:05.243815 31705 raft_consensus.cc:3055] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.281287 31705 raft_consensus.cc:740] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:05.271044 31616 consensus_queue.cc:260] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.260857 31675 raft_consensus.cc:740] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:05.282621 31616 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.283757 31675 consensus_queue.cc:260] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.285607 31675 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.285903 31684 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.275723 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.282478 31705 consensus_queue.cc:260] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.277884 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.289258 31705 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.249285 30478 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:05.294211 31721 raft_consensus.cc:2749] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:05.297441 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:05.301263 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.304589 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.305446 30366 raft_consensus.cc:1240] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.311810 31711 tablet_copy_client.cc:538] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:05.314180 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.315434 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.264488 31715 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:05.320338 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.322350 30477 raft_consensus.cc:1240] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.325246 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.328994 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:05.329131 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:05.333870 31680 tablet_copy_client.cc:538] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260807 07:57:05.334471 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 91817.5us
I20260807 07:57:05.336658 31622 consensus_queue.cc:1059] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:05.338465 31622 consensus_queue.cc:1059] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:05.338958 31734 raft_consensus.cc:3060] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.339650 31661 raft_consensus.cc:3055] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.340173 31661 raft_consensus.cc:740] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:05.342155 30539 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:57:05.342952 30430 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:05.343521 31670 raft_consensus.cc:3055] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.343086 31715 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:05.344753 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.345016 31715 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.345829 30587 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:05.347246 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:05.348121 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:05.348328 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.349426 31670 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:05.351226 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.352145 31715 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:05.344013 31661 consensus_queue.cc:260] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.354637 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.355077 31661 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.355499 31720 raft_consensus.cc:1064] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:05.355996 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.357492 30582 raft_consensus.cc:2393] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:05.351223 31670 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.359726 31670 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.362389 31720 consensus_queue.cc:237] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:05.371997 30320 leader_election.cc:336] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.518s (SENT)
I20260807 07:57:05.346220 31616 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:05.377625 30320 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:05.383798 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.387727 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:05.392717 31616 raft_consensus.cc:697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:05.392874 31715 consensus_queue.cc:1059] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:05.397361 31729 raft_consensus.cc:3055] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.397975 31729 raft_consensus.cc:740] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:05.397605 31616 consensus_queue.cc:237] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.399507 31729 consensus_queue.cc:260] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.393639 31740 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.401371 31729 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:05.413717 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:05.418910 30430 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:05.449548 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:05.454548 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:05.450681 30320 leader_election.cc:336] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.521s (SENT)
I20260807 07:57:05.455935 30320 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:05.460847 31740 raft_consensus.cc:2749] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.464699 30581 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
W20260807 07:57:05.464985 30320 leader_election.cc:336] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.524s (SENT)
I20260807 07:57:05.470007 30320 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
W20260807 07:57:05.471022 30320 leader_election.cc:336] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.525s (SENT)
I20260807 07:57:05.471401 30320 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:05.472154 31715 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.472450 31740 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.479219 31680 tablet_bootstrap.cc:492] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
W20260807 07:57:05.479718 30320 leader_election.cc:336] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.565s (SENT)
I20260807 07:57:05.492769 30581 raft_consensus.cc:1240] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.493331 30586 raft_consensus.cc:1240] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.495399 30590 raft_consensus.cc:1240] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.496269 30586 raft_consensus.cc:1240] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.496487 30590 raft_consensus.cc:1240] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.496213 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.499054 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.501443 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.501721 30582 raft_consensus.cc:1240] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.502739 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.503425 30582 raft_consensus.cc:2393] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:05.503490 30588 raft_consensus.cc:1240] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.504453 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.504966 30584 raft_consensus.cc:1240] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.505519 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.505967 31715 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:05.473654 31711 tablet_bootstrap.cc:492] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:05.506518 31715 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.506551 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.508503 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.507373 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.510571 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.511737 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.512943 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.513984 30581 raft_consensus.cc:1240] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.516242 30581 raft_consensus.cc:1240] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.516618 30587 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:05.521929 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.523289 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.526144 30586 raft_consensus.cc:2393] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:05.511657 30578 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:05.531975 31383 raft_consensus.cc:1275] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:57:05.533207 30585 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
W20260807 07:57:05.545240 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:05.539244 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:05.550258 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.558229 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.558888 30585 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:05.559279 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.560570 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.562299 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.564105 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.546851 31734 consensus_queue.cc:1048] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
W20260807 07:57:05.565979 30320 leader_election.cc:336] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.643s (SENT)
I20260807 07:57:05.564491 30223 catalog_manager.cc:5697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 2, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 2 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:05.576911 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.577740 30581 raft_consensus.cc:2393] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:05.538329 31715 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:05.590354 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.590847 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.591020 30581 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:05.591763 30584 raft_consensus.cc:2393] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:05.592233 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.592733 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.610711 30579 raft_consensus.cc:1240] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.611346 30364 raft_consensus.cc:1275] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:57:05.611904 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.612993 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.614041 31734 consensus_queue.cc:1048] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:05.614825 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.615922 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.611404 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.616679 30581 raft_consensus.cc:2393] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:05.614183 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.619001 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.621888 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.623762 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.625186 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.626981 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.627425 31698 tablet_bootstrap.cc:492] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:05.627760 30590 raft_consensus.cc:2393] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:05.628300 31698 tablet_bootstrap.cc:492] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:05.629036 31698 ts_tablet_manager.cc:1403] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.452s user 0.021s sys 0.008s
I20260807 07:57:05.629091 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.632313 31698 raft_consensus.cc:359] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:05.633100 31698 raft_consensus.cc:740] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:05.633778 31698 consensus_queue.cc:260] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:05.636893 30590 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:05.638933 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.639701 30584 raft_consensus.cc:2393] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:05.640588 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.641901 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.642598 30586 raft_consensus.cc:2393] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:05.643870 31698 ts_tablet_manager.cc:1434] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.014s user 0.002s sys 0.004s
I20260807 07:57:05.651630 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.651906 30502 tablet_copy_service.cc:342] P ef1ca7acf52a438f89f14707e9e06818: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-39d207f188764d0caf032e77702cdc6b received from {username='slave'} at 127.0.0.1:34358
I20260807 07:57:05.651965 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.652567 30502 tablet_copy_service.cc:434] P ef1ca7acf52a438f89f14707e9e06818: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-39d207f188764d0caf032e77702cdc6b on tablet 39d207f188764d0caf032e77702cdc6b with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:05.652833 30586 raft_consensus.cc:2393] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:05.654088 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.655442 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.656780 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.658102 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.658782 30586 raft_consensus.cc:2393] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:05.659231 30581 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:05.660019 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.660861 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:05.661561 30590 raft_consensus.cc:2393] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:05.663450 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:05.665544 30430 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:05.665675 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.667353 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.669513 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.669556 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:05.673923 30320 leader_election.cc:336] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.755s (SENT)
I20260807 07:57:05.674351 30320 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:05.677831 31729 raft_consensus.cc:2749] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.678416 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.668672 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.682857 30581 raft_consensus.cc:2393] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:05.694515 31383 raft_consensus.cc:1217] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 07:57:05.688774 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:05.698081 30320 leader_election.cc:336] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.778s (SENT)
I20260807 07:57:05.698570 30320 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:05.699688 31740 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.700425 31711 tablet_bootstrap.cc:492] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:05.701368 31711 tablet_bootstrap.cc:492] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:05.702142 31711 ts_tablet_manager.cc:1403] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.279s user 0.020s sys 0.005s
I20260807 07:57:05.708927 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.710875 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.713800 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.717738 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.717079 31734 raft_consensus.cc:2955] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:05.720767 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.722283 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.722357 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.723448 30581 raft_consensus.cc:2376] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2. Re-sending same reply.
I20260807 07:57:05.723466 30366 raft_consensus.cc:2955] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:05.730958 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.731638 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.732005 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.732395 30581 raft_consensus.cc:2393] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:05.731681 30590 raft_consensus.cc:2393] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:05.733227 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.733332 31383 raft_consensus.cc:2955] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:05.733641 31711 raft_consensus.cc:359] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:05.738289 31711 raft_consensus.cc:740] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:05.738991 31711 consensus_queue.cc:260] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:05.741552 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.742408 30584 raft_consensus.cc:2393] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
W20260807 07:57:05.742888 30320 leader_election.cc:336] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.829s (SENT)
I20260807 07:57:05.743309 30320 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:05.744169 30590 raft_consensus.cc:1240] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.745086 31740 raft_consensus.cc:2749] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.745782 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.746490 30579 raft_consensus.cc:2376] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2. Re-sending same reply.
I20260807 07:57:05.748049 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.748690 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.749264 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.749701 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.750480 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.750864 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.751577 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.751830 31711 ts_tablet_manager.cc:1434] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.049s user 0.006s sys 0.001s
I20260807 07:57:05.752445 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.752619 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.754408 30385 tablet_copy_service.cc:342] P b1188d7d3a0b455894bc443d571f6a19: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-14880a591ef44360b5046f67cab3d4ad received from {username='slave'} at 127.0.0.1:33338
I20260807 07:57:05.754865 30385 tablet_copy_service.cc:434] P b1188d7d3a0b455894bc443d571f6a19: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-14880a591ef44360b5046f67cab3d4ad on tablet 14880a591ef44360b5046f67cab3d4ad with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:05.756856 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.759083 30367 raft_consensus.cc:1240] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.762730 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.757236 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.767207 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.767475 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.768106 30373 raft_consensus.cc:1240] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.764490 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.769938 30367 raft_consensus.cc:1240] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
W20260807 07:57:05.770870 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:05.776571 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:05.768862 30363 raft_consensus.cc:1240] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
W20260807 07:57:05.780157 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:05.781324 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.791092 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.794083 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.797825 31620 consensus_queue.cc:1059] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:05.797327 30223 catalog_manager.cc:5697] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:05.798974 31620 raft_consensus.cc:3055] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.798237 31719 consensus_queue.cc:1059] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:05.799371 31620 raft_consensus.cc:740] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:05.799897 31719 raft_consensus.cc:3055] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.800239 31719 raft_consensus.cc:740] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:05.800235 31620 consensus_queue.cc:260] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.802232 31620 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.803781 31680 tablet_bootstrap.cc:492] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:05.801077 31719 consensus_queue.cc:260] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:05.804739 31680 tablet_bootstrap.cc:492] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:05.811044 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.806695 31719 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:05.818073 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:05.822343 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.823660 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.826277 31680 ts_tablet_manager.cc:1403] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.347s user 0.018s sys 0.027s
I20260807 07:57:05.827719 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.829300 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.830698 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.834009 31680 raft_consensus.cc:359] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:05.846408 30358 raft_consensus.cc:1240] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.846562 31680 raft_consensus.cc:740] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:05.835146 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.836871 30373 raft_consensus.cc:1240] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.837031 30372 raft_consensus.cc:1240] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.847296 31680 consensus_queue.cc:260] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:05.838027 30364 raft_consensus.cc:1240] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:05.838111 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:05.850050 31680 ts_tablet_manager.cc:1434] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.023s user 0.006s sys 0.001s
I20260807 07:57:05.851724 30385 tablet_copy_service.cc:342] P b1188d7d3a0b455894bc443d571f6a19: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-d30d61dc67614c5c9d0f1083e2a463b9 received from {username='slave'} at 127.0.0.1:33338
I20260807 07:57:05.852097 30385 tablet_copy_service.cc:434] P b1188d7d3a0b455894bc443d571f6a19: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-d30d61dc67614c5c9d0f1083e2a463b9 on tablet d30d61dc67614c5c9d0f1083e2a463b9 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
W20260807 07:57:05.842072 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 45210.2us
I20260807 07:57:05.855110 31664 consensus_queue.cc:1059] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:05.856243 30367 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:05.856393 31664 raft_consensus.cc:3055] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.856806 31664 raft_consensus.cc:740] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:05.857673 31664 consensus_queue.cc:260] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.859097 31664 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.863036 30488 raft_consensus.cc:1240] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
W20260807 07:57:05.866691 30320 leader_election.cc:336] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.843s (SENT)
I20260807 07:57:05.869549 31616 consensus_queue.cc:1059] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:05.876127 30320 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:05.876559 31661 raft_consensus.cc:3055] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.876819 31740 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:05.877224 30320 leader_election.cc:336] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.854s (SENT)
I20260807 07:57:05.876977 31661 raft_consensus.cc:740] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:05.877681 30320 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:05.878409 31740 raft_consensus.cc:2749] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.878269 31661 consensus_queue.cc:260] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.879815 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.880069 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:05.880930 30320 leader_election.cc:336] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.882s (SENT)
I20260807 07:57:05.881525 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:05.881942 30320 leader_election.cc:336] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.921s (SENT)
I20260807 07:57:05.882113 30590 raft_consensus.cc:2376] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2. Re-sending same reply.
I20260807 07:57:05.882340 30320 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
W20260807 07:57:05.882966 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:05.883076 31740 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.879382 31661 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.886539 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.887979 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.888659 30590 raft_consensus.cc:2393] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:05.889833 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.891536 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.892071 31761 consensus_queue.cc:1059] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:05.894042 31734 raft_consensus.cc:3055] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.894377 31734 raft_consensus.cc:740] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:05.895226 31734 consensus_queue.cc:260] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.899281 31734 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:05.905704 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:05.906433 30541 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:05.907574 31684 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.908718 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:05.909210 30541 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:05.910002 31684 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.911302 30541 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:05.912032 31684 raft_consensus.cc:2749] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.913157 30541 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:05.914096 31684 raft_consensus.cc:2749] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.915346 30541 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:05.915220 31761 consensus_queue.cc:1059] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:05.915524 31620 consensus_queue.cc:1059] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:05.916415 31620 raft_consensus.cc:3055] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.916728 31719 raft_consensus.cc:3055] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.916844 31620 raft_consensus.cc:740] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:05.917143 31719 raft_consensus.cc:740] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:05.917727 31620 consensus_queue.cc:260] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:05.918138 31719 consensus_queue.cc:260] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.919047 31620 raft_consensus.cc:3060] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.919382 31719 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.916368 31761 consensus_queue.cc:1059] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260807 07:57:05.921627 31718 raft_consensus.cc:3055] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.921990 31718 raft_consensus.cc:740] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:05.922842 31718 consensus_queue.cc:260] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.924147 31718 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.929569 31761 consensus_queue.cc:1059] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:05.930665 31720 raft_consensus.cc:3055] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.930994 31720 raft_consensus.cc:740] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:05.931851 31720 consensus_queue.cc:260] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.933691 31720 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:05.935741 30541 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:05.936965 31661 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.945201 31684 raft_consensus.cc:2749] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.945070 31719 consensus_queue.cc:1059] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:05.947239 31719 raft_consensus.cc:3055] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
W20260807 07:57:05.947417 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:05.947842 31719 raft_consensus.cc:740] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:05.949462 30541 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:05.949843 31719 consensus_queue.cc:260] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:05.953286 30541 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:05.954221 31661 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.955967 31719 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:05.967288 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:05.969354 31684 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.969955 30541 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:05.972834 31675 raft_consensus.cc:2749] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.973218 30541 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:05.976075 31661 raft_consensus.cc:2749] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.976650 30541 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:05.971903 30429 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:05.989902 31661 raft_consensus.cc:2749] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.990458 30429 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:05.991681 30429 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:05.992278 31664 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.991729 31761 raft_consensus.cc:2749] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.993744 31664 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.994014 31734 consensus_queue.cc:1059] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:05.990386 30541 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:05.995525 31661 raft_consensus.cc:2749] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.996606 30429 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:05.997987 30429 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:05.998451 31761 raft_consensus.cc:3055] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:05.998720 31719 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.999179 31620 raft_consensus.cc:2749] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:05.999892 30429 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.001245 30429 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.001935 31719 raft_consensus.cc:2749] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.002616 31719 raft_consensus.cc:2749] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.003683 30429 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:06.004456 31734 raft_consensus.cc:2804] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:05.998857 31761 raft_consensus.cc:740] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:06.005749 31761 consensus_queue.cc:260] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:05.979018 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 72321.9us
I20260807 07:57:06.007026 31761 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.008993 31762 consensus_queue.cc:1059] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:06.013615 31734 raft_consensus.cc:697] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:06.014781 31734 consensus_queue.cc:237] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.017938 31762 raft_consensus.cc:3055] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:06.018311 31762 raft_consensus.cc:740] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:06.018953 30541 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.019146 31762 consensus_queue.cc:260] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.020438 31762 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.004709 30429 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.021711 30429 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.021963 31719 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.020328 30320 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.022868 30429 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.022500 31620 raft_consensus.cc:2749] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.024609 31675 raft_consensus.cc:2749] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.025923 31719 raft_consensus.cc:2749] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.026031 30429 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.027006 31661 consensus_queue.cc:1059] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:06.027554 30429 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.028178 31675 raft_consensus.cc:3055] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:06.028571 31675 raft_consensus.cc:740] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:06.028892 31719 raft_consensus.cc:2749] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.028420 31620 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.029994 30429 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.029623 31675 consensus_queue.cc:260] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.032536 31675 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.032771 31719 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.032557 30429 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.035094 30320 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.035917 31729 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.036372 30320 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.038003 30320 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.038710 31695 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.038978 30320 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.034700 31762 raft_consensus.cc:2749] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.046126 30220 catalog_manager.cc:5697] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 2, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 2 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:06.049537 31719 raft_consensus.cc:2749] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.049968 31740 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:06.050006 31729 raft_consensus.cc:2804] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:06.050439 31740 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:06.050721 31729 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:06.050865 31740 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.051124 31729 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.051546 30429 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:06.052656 31719 raft_consensus.cc:2804] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:06.053092 31719 raft_consensus.cc:697] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:06.053932 31719 consensus_queue.cc:237] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.057945 31740 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.060035 31740 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:06.060786 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:06.060890 30320 leader_election.cc:304] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:57:06.062353 30320 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.062194 30429 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.064030 30320 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.064232 31734 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.065151 30429 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.065364 31695 raft_consensus.cc:2749] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.065979 31734 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.066322 30429 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.062892 31740 raft_consensus.cc:2749] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.063843 31762 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.071223 31734 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.072661 30429 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.073509 31734 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.075241 30429 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.075845 31383 raft_consensus.cc:1217] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 07:57:06.076233 31734 raft_consensus.cc:2749] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.078116 30429 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.079010 31715 raft_consensus.cc:2804] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:06.080951 31715 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:06.081645 31715 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.082098 30320 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.083055 31695 consensus_queue.cc:1059] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:06.085443 31740 raft_consensus.cc:2749] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.093998 31734 raft_consensus.cc:2749] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.096088 30429 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.079855 31729 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.099045 31734 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:06.100386 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 66164.7us
I20260807 07:57:06.102906 30541 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.103231 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:06.069294 31620 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.107589 30541 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.107082 31684 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.110661 31661 raft_consensus.cc:2749] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.111023 30541 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.101013 30429 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.113592 31675 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.114217 31762 raft_consensus.cc:3055] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:06.115320 31734 raft_consensus.cc:2749] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.114504 30541 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.117090 30429 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.117558 30541 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.112937 30320 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.118849 30320 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.115690 31762 raft_consensus.cc:740] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:06.120641 31762 consensus_queue.cc:260] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.113965 31729 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:06.124094 31695 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.124507 31684 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.125229 30541 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.126163 31684 raft_consensus.cc:2749] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.126410 30541 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.123072 31762 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.126878 31734 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.127211 31684 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.127234 31675 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.128930 30429 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.127497 30541 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.132354 30541 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.132287 30320 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.130571 31695 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.133649 31684 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.131402 31734 raft_consensus.cc:2749] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.134759 31675 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.126824 31715 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.144582 30541 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.145896 30320 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:57:06.145869 30220 catalog_manager.cc:5697] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 2, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 2 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:06.146086 31675 raft_consensus.cc:2749] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.148211 31740 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.149169 30429 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.155867 31734 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.149505 31715 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:06.150106 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:06.145864 31766 raft_consensus.cc:2749] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.159879 30320 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.160674 31766 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.161041 30320 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.164021 30320 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.164824 31715 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:06.162850 30429 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.165274 31715 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:06.162117 30541 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.165868 31715 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.166584 31675 raft_consensus.cc:2749] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.167865 30541 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.168920 30429 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.169714 31719 raft_consensus.cc:2749] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.170465 30429 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.171231 31719 raft_consensus.cc:2749] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.171583 30429 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.172317 31719 raft_consensus.cc:2749] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.172672 30429 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:06.166121 31734 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.173413 31719 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.175421 31675 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.165030 31762 raft_consensus.cc:2749] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.165201 30320 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.184386 31719 raft_consensus.cc:2749] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.184950 30320 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.189616 31762 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.189996 30320 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.190742 31767 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:06.185463 31766 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.185994 31684 consensus_queue.cc:1059] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:06.186787 31715 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.186995 31675 consensus_queue.cc:1059] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:06.191892 31684 raft_consensus.cc:3055] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:06.191988 31675 raft_consensus.cc:3055] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:06.192297 31684 raft_consensus.cc:740] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:06.192495 31675 raft_consensus.cc:740] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:06.193223 31684 consensus_queue.cc:260] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.193440 31675 consensus_queue.cc:260] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.194686 31684 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.196537 31715 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:06.194813 31675 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.197255 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:06.187135 30541 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.203881 31762 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.191190 31767 raft_consensus.cc:697] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:06.204041 31616 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.208181 30488 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:06.188378 30429 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
W20260807 07:57:06.204445 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:06.210124 31719 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.191087 30320 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.212108 31661 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:06.212414 30320 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.212929 31762 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:06.213492 31661 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:06.213979 31661 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:06.216217 31661 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:06.207827 31767 consensus_queue.cc:237] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.216683 31719 consensus_queue.cc:1059] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:06.218061 31719 raft_consensus.cc:3055] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:06.218398 31719 raft_consensus.cc:740] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:06.219432 31719 consensus_queue.cc:260] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:06.220963 31719 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.221117 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:06.221596 31766 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:06.222148 31766 raft_consensus.cc:697] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:06.223043 31766 consensus_queue.cc:237] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.223879 31762 raft_consensus.cc:697] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:06.225899 31616 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:06.230773 31616 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.232795 30364 raft_consensus.cc:1240] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:06.233991 31616 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:06.224886 31762 consensus_queue.cc:237] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.243305 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:06.227960 30320 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.261826 30320 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.263157 31715 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:06.267393 30320 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.269857 31715 raft_consensus.cc:697] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:06.274230 31715 consensus_queue.cc:237] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.279624 31383 raft_consensus.cc:1217] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260807 07:57:06.267014 31767 raft_consensus.cc:2749] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.290081 31766 raft_consensus.cc:2749] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:06.319922 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 52593us
I20260807 07:57:06.318727 30221 catalog_manager.cc:5697] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 2, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:06.324298 30320 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.326236 30320 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
W20260807 07:57:06.334378 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 71678.7us
W20260807 07:57:06.354197 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:06.334844 31762 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.357776 31664 consensus_queue.cc:1059] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:06.359431 31718 raft_consensus.cc:3055] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:06.359992 31718 raft_consensus.cc:740] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:06.361768 31718 consensus_queue.cc:260] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.367576 31718 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:06.376572 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 50407.8us
I20260807 07:57:06.377638 30320 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.392484 30320 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.394510 31695 raft_consensus.cc:2749] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.397426 30364 raft_consensus.cc:1240] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:06.398627 30367 raft_consensus.cc:1240] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:06.385178 31766 raft_consensus.cc:2749] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.389334 31684 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:06.403820 31684 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.408300 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:06.409092 30587 raft_consensus.cc:2393] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:06.411787 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:06.412984 30366 raft_consensus.cc:1240] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:06.415867 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:06.417810 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:06.418077 30366 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:06.418493 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:06.388411 31767 raft_consensus.cc:2749] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.426810 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:06.428145 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:06.432694 31735 consensus_queue.cc:1059] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:06.435453 31684 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:06.436472 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:06.437664 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:06.438069 30541 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.445261 30582 raft_consensus.cc:1240] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:06.448155 31768 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:06.448863 31616 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.451032 30541 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.451797 31768 raft_consensus.cc:2749] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.434804 31735 raft_consensus.cc:3055] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:06.453593 31735 raft_consensus.cc:740] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:06.454907 31735 consensus_queue.cc:260] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.456773 31735 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.468622 30320 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.469542 31766 raft_consensus.cc:2749] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.473229 30320 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.477808 31664 consensus_queue.cc:1059] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:06.479382 31719 raft_consensus.cc:3055] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:06.479956 31719 raft_consensus.cc:740] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:06.480083 31766 raft_consensus.cc:2749] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.481698 31664 consensus_queue.cc:1059] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:06.481408 31719 consensus_queue.cc:260] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.482637 30320 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.483726 31719 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.480657 30221 catalog_manager.cc:5697] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 2, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:06.487485 31620 raft_consensus.cc:3055] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:06.487223 30221 catalog_manager.cc:5697] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 2, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:06.488049 31620 raft_consensus.cc:740] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:06.489084 30221 catalog_manager.cc:5697] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 2, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:06.489351 31620 consensus_queue.cc:260] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.516110 31620 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.517654 31729 raft_consensus.cc:1064] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:06.491731 31766 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:06.521538 31720 consensus_queue.cc:1175] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f831a53ec51d452398015797d543164e" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260807 07:57:06.492810 30320 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.498627 30358 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:06.507254 30366 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.526796 30320 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:06.527648 31740 raft_consensus.cc:2749] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.528795 31740 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.535677 30366 raft_consensus.cc:1275] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:06.544332 31740 consensus_queue.cc:1059] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:06.547045 31740 raft_consensus.cc:3055] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:06.547683 31740 raft_consensus.cc:740] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:06.550552 31740 consensus_queue.cc:260] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:06.552728 31740 raft_consensus.cc:3060] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:06.549032 31729 consensus_queue.cc:237] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:06.510491 31762 raft_consensus.cc:2749] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.571903 31719 consensus_queue.cc:1048] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:06.570958 31735 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 07:57:06.557874 30541 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:06.574111 31684 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.608551 30578 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:06.661149 31735 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:06.662264 31735 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:06.719988 31766 raft_consensus.cc:2749] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:06.729950 31735 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:07.172765 31767 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.173512 31767 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:07.175936 31767 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.225322 31768 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.226135 31768 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.225370 31684 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.232717 31684 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.235026 31684 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.271873 31715 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.272672 31715 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.274933 31715 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.295612 31768 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.335100 31768 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.335811 31768 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.343472 31616 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.344175 31616 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.346464 31616 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.478979 31788 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.479694 31788 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.482263 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.483346 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.622717 30488 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:07.622670 30489 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:07.483659 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.506755 31664 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.623852 31664 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.625850 31664 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.626644 30478 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:07.545756 31684 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.627667 31684 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.582165 31790 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.625239 31788 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.628585 31790 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.630615 31790 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.573371 31715 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.604571 31793 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:07.631366 31715 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:07.631506 31793 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.614530 31792 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.615343 31695 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.622097 31798 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.566929 31616 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.634120 31715 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:07.636332 31695 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:07.639185 31684 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.640127 31684 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.640414 31695 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:07.641911 31793 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.652172 31799 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.652668 31799 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.656086 31800 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.656576 31800 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.657401 30539 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:07.659031 31800 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.659675 30539 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:07.660189 31800 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:07.660591 31800 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:07.660939 31800 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:07.660108 31801 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.662467 31801 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.646037 31792 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.666431 31801 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.666975 31801 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:07.667326 31801 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:07.667663 31801 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:07.668078 31792 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.646111 31798 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.640555 31684 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:07.677235 30539 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:07.682262 31798 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.683305 31684 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:07.689415 31684 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.689863 31684 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:07.691866 31684 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.692360 31684 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:07.692662 31684 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:07.692984 31684 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:07.653757 31718 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:07.693717 31718 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.695590 31718 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:07.700260 31729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.984s user 0.001s sys 0.008s
W20260807 07:57:07.700666 31729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s user 0.001s sys 0.008s
I20260807 07:57:07.646005 31616 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.703477 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:07.719020 31384 raft_consensus.cc:2468] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:07.720652 30542 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:07.695493 30364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45054 (request call id 635) took 1089 ms. Trace:
W20260807 07:57:07.721462 30366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.143s user 0.021s sys 0.012s
I20260807 07:57:07.721565 30364 rpcz_store.cc:276] 0807 07:57:06.605998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:07.694563 (+1088565us) service_pool.cc:224] Handling call
0807 07:57:07.694921 (+ 358us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:07.695122 (+ 201us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:07.695160 (+ 38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:07.695207 (+ 47us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:07.695249 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:07.695313 (+ 64us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:07.695435 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:57:07.706074 31799 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.724264 31616 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.724851 31616 raft_consensus.cc:2804] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:07.725180 31616 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:07.725521 31616 raft_consensus.cc:3060] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:07.725952 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:07.726567 31383 raft_consensus.cc:2468] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
W20260807 07:57:07.728637 30366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.150s user 0.021s sys 0.012s
I20260807 07:57:07.735508 30366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45046 (request call id 759) took 1153 ms. Trace:
I20260807 07:57:07.734959 30430 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:07.737182 31792 raft_consensus.cc:2804] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 07:57:07.736164 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 56975.4us
I20260807 07:57:07.737546 31792 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:07.737811 31788 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:07.735867 30366 rpcz_store.cc:276] 0807 07:57:06.576129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:06.576274 (+ 145us) service_pool.cc:224] Handling call
0807 07:57:06.576617 (+ 343us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:06.577595 (+ 978us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:06.577622 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:06.578064 (+ 442us) log.cc:844] Serialized 26 byte log entry
0807 07:57:07.729026 (+1150962us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:07.729064 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:07.729124 (+ 60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:07.729163 (+ 39us) raft_consensus.cc:1685] finished
0807 07:57:07.729174 (+ 11us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:07.729277 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4698,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":293,"thread_start_us":1150624,"threads_started":1,"wal-append.queue_time_us":163678}
I20260807 07:57:07.738473 31788 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:07.737948 31792 raft_consensus.cc:3060] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:07.740587 31788 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.748790 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.749552 30479 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:07.752151 30489 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:07.756767 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.757400 30479 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:07.736594 31798 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.761320 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.768636 30479 raft_consensus.cc:2468] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:07.770153 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.770968 30488 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:07.774783 31766 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.775302 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.775885 30489 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:07.775305 31766 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.776865 31811 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.777341 31811 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:07.777611 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.778353 30488 raft_consensus.cc:2468] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:07.779486 31811 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.779974 31811 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.780364 31811 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:07.780619 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.747790 31793 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.781209 30489 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:07.781644 31793 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.783085 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.780735 31768 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.786643 30488 raft_consensus.cc:1275] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:07.767717 31790 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.794106 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:07.797871 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.794576 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.794811 30587 raft_consensus.cc:2393] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:07.796803 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.794131 31803 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.800053 30364 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:07.801326 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:07.801982 31383 raft_consensus.cc:2468] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:07.796936 30586 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:07.797128 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.798772 30479 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:07.794694 31768 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.806722 31768 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.807732 31797 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.795565 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.772223 31798 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.811796 31798 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.793990 31788 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:07.794795 31792 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:07.812641 31788 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.813675 30480 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:07.814704 31788 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.792735 31718 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.816345 31718 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.813295 31768 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.787590 31790 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.822700 31798 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.832670 30586 raft_consensus.cc:1275] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:07.820765 31790 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.818120 31792 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:07.832422 31798 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.825709 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:07.823441 31793 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.822814 31788 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:07.840540 31383 raft_consensus.cc:3060] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:07.828377 31684 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.841859 31798 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.842398 31684 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.823227 31800 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.843187 31811 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.843711 31811 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.838920 31695 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:57:07.829352 31740 consensus_meta.cc:287] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 1.133s user 0.012s sys 0.003s
I20260807 07:57:07.820979 31735 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.848858 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.844194 31800 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.850332 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.850579 31735 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.851066 30489 raft_consensus.cc:2393] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:07.849152 31695 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.852841 31695 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.853188 31735 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.849224 31620 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.853864 31620 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:07.856400 31620 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:07.853758 31812 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.818379 31718 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.828944 31766 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.857455 31793 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.857265 31812 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.821050 31805 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:07.858850 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:07.829239 31803 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.859592 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:07.860332 30581 raft_consensus.cc:2393] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:07.844168 31811 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:07.833966 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:07.860888 31803 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.858017 31793 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.863049 30479 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:07.861176 31382 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:07.874439 31800 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:57:07.876467 30358 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.293s user 0.015s sys 0.014s
I20260807 07:57:07.876595 31800 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:07.877825 30358 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.295s user 0.015s sys 0.014s
I20260807 07:57:07.829087 31797 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.849627 31801 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.879701 31797 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.861120 31788 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.879686 31801 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.880383 31805 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.881732 31664 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:07.882251 31664 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:07.883754 30367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.303s user 0.006s sys 0.022s
W20260807 07:57:07.884161 30367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.303s user 0.006s sys 0.022s
I20260807 07:57:07.884369 31718 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.882139 31720 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.885211 31720 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.886646 31788 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.887063 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.888239 31800 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.837569 31809 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.884099 31664 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.889029 31809 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.865299 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.889704 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:07.888399 31720 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.884841 31718 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.899107 30482 raft_consensus.cc:1275] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:07.899019 30323 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
I20260807 07:57:07.899226 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.899988 30373 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:07.901455 31740 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.902101 31740 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.902640 31718 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.898325 31715 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.903290 30588 raft_consensus.cc:1240] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:07.903661 31715 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.903976 31740 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.904544 31740 raft_consensus.cc:2804] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:07.904847 31740 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:07.905123 31740 raft_consensus.cc:3060] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:07.905792 31715 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.907337 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.876899 31616 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:07.910290 30479 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:07.913434 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.901259 30480 raft_consensus.cc:2393] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:07.884883 31805 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.898624 31797 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.919821 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.922013 30365 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:07.917498 31767 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.922719 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.922943 31767 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.923350 30369 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:07.924499 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.924908 31767 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.920596 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.921159 31384 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:57:07.926442 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.928568 31793 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.930799 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:07.931257 30539 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:07.932168 30539 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:07.936220 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:07.937242 30581 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:07.910013 31809 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.939201 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:07.915131 31715 raft_consensus.cc:1064] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:07.943869 31799 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:07.944164 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.943984 31766 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.947646 30373 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:07.944504 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:07.910645 31800 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.945714 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.873636 31729 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:07.884159 31811 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.949735 30588 raft_consensus.cc:2368] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:07.950894 30578 raft_consensus.cc:2368] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 2. Current term is 3.
I20260807 07:57:07.951020 31695 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:07.951239 31766 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.950912 31768 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.959138 31768 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.953099 31799 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:07.961093 31768 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.945448 31803 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:07.944283 31767 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.953723 31720 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260807 07:57:07.965462 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.966133 30360 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 1.
I20260807 07:57:07.961606 31799 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.962492 31800 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:07.967437 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.958745 31795 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:07.968152 30369 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:07.968387 31795 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.969197 30581 raft_consensus.cc:2393] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:07.970364 31795 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.970506 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:07.951100 31804 raft_consensus.cc:2804] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:07.973030 31804 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:07.973237 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.973709 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.974190 30369 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:07.974291 30373 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:07.970808 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.968993 31800 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.976092 30360 raft_consensus.cc:2393] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:07.976567 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.977098 30373 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:07.977731 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.977957 31812 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.978309 30365 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:07.951323 31814 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:07.962852 31729 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.979457 31814 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:07.980477 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.982497 30372 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:07.980619 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.983282 30373 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:07.986617 31383 raft_consensus.cc:2468] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:07.987128 31766 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:07.982963 31803 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:07.988461 31803 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:07.989076 30430 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:07.990924 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.992651 31616 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:07.973723 31804 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:07.991959 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:07.993896 31718 raft_consensus.cc:2804] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:07.936620 31793 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:08.000538 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:08.000840 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:08.001331 30372 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
W20260807 07:57:08.001936 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 51201.8us
I20260807 07:57:08.002719 30539 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.003547 31720 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:08.004346 31720 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.005234 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:08.005587 31790 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:08.006444 31790 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.007695 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:08.008522 31720 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.010645 30539 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.024430 30578 raft_consensus.cc:1275] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:08.024852 31809 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.025487 31809 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.026235 31809 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.020396 31795 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:08.029482 31795 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.030352 30539 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.031795 31768 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.032368 31768 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.032848 31768 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.022334 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.011296 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:08.034574 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:08.034996 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.035116 30372 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:08.035552 30479 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:08.035915 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:08.036151 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.037096 30477 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:08.038030 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.039767 31814 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.035696 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.042171 30488 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:57:08.042464 31718 raft_consensus.cc:697] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:08.015784 30367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45046 (request call id 760) took 1435 ms. Trace:
I20260807 07:57:08.021665 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.043455 30586 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:08.044296 30367 rpcz_store.cc:276] 0807 07:57:06.580106 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:06.580254 (+ 148us) service_pool.cc:224] Handling call
0807 07:57:06.580558 (+ 304us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:07.884567 (+1304009us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:07.884596 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:07.885073 (+ 477us) log.cc:844] Serialized 26 byte log entry
0807 07:57:08.005419 (+120346us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:08.005461 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:08.011294 (+ 5833us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:08.015585 (+ 4291us) raft_consensus.cc:1685] finished
0807 07:57:08.015603 (+ 18us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:08.015726 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1282,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":161,"thread_start_us":1423574,"threads_started":2,"wal-append.queue_time_us":117137}
I20260807 07:57:08.029989 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:08.044968 31793 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.046212 30363 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:08.036471 30372 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:08.041020 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.048205 30489 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:08.033275 31795 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:07.998879 31767 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.053109 31719 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:08.053907 31719 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:07.982409 31715 consensus_queue.cc:237] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:08.042739 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.056391 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.057339 31719 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.023756 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:08.058203 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.018955 31799 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:08.060685 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.059952 30489 raft_consensus.cc:2468] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 2.
I20260807 07:57:07.945154 31797 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.058409 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.059556 30478 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:08.019655 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:08.067091 30373 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:08.067672 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:08.068410 30369 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:08.015590 31801 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:08.069923 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:08.049791 31800 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.070547 30480 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 2.
I20260807 07:57:08.052500 31767 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.076594 30365 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:08.066318 31799 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.048769 31793 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.101683 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.097481 31800 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.102767 31797 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.020859 31616 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:08.065093 31383 raft_consensus.cc:3060] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.044137 31718 consensus_queue.cc:237] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:08.104310 30587 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:08.105398 30478 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:08.108984 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.120335 30586 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:08.121019 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:08.110929 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.113607 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.076893 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:57:08.124416 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 58701.7us
I20260807 07:57:08.115585 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.125368 30585 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:08.126739 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:08.127295 30373 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:08.117159 31336 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:08.118359 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.118170 31616 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.121657 30581 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:08.113976 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:08.118806 31814 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:08.114694 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.109371 31795 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:08.122124 30582 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:08.128561 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.136359 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.136555 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.137050 30585 raft_consensus.cc:2393] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:08.136914 30582 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:08.137737 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.138386 30582 raft_consensus.cc:2393] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:08.138865 30429 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.103107 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.130406 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.132043 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.142902 30588 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:08.142987 30581 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:08.121181 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.113157 31800 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.103869 31801 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.144130 30586 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:08.147837 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.146641 30429 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.148015 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.150050 30429 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.128348 30364 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.129546 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.154937 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.157021 30582 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:08.152809 30429 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.158697 31735 raft_consensus.cc:2804] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.159825 31338 leader_election.cc:400] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 2. Current term is 3.
I20260807 07:57:08.160331 31338 leader_election.cc:403] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:57:08.152832 31675 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:08.132491 31729 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.163625 30429 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.167397 30429 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.167507 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.164146 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.168149 30586 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:08.152235 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.145175 31719 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.171041 30429 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.172487 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.154425 31620 raft_consensus.cc:2804] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.175177 31788 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.159082 31820 raft_consensus.cc:2749] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:08.193969 31788 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.194635 31788 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.195504 31801 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.141616 31814 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.196359 31809 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.199321 31799 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.200295 31814 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.200805 31809 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.201570 31616 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:08.202042 30319 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:08.203579 31800 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:08.207053 31800 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.208510 30364 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:08.189493 30588 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:08.185519 31740 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:08.169622 31818 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:08.177107 31719 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.159349 31735 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.189935 30429 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.192037 31805 raft_consensus.cc:2804] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.171258 31798 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.170540 31675 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:08.170010 30579 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:08.148955 31795 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:08.170033 31664 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.151652 31766 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:08.173790 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 77643.8us
I20260807 07:57:08.193557 31620 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.224032 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.214385 30358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45054 (request call id 633) took 1597 ms. Trace:
I20260807 07:57:08.226840 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.227638 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.229790 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.231580 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:08.228727 30429 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:08.237416 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 72889.8us
I20260807 07:57:08.239799 30366 raft_consensus.cc:2393] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:08.225567 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:08.247948 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:08.259539 30490 raft_consensus.cc:3060] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.248608 30489 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.255966 30482 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.243136 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.247176 30581 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:08.249511 30429 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.246637 30479 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:08.246183 30317 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.265271 30317 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.218928 31719 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.266738 30317 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.229171 31735 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.242645 31664 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.242651 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.277007 31729 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:08.227927 31805 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.282392 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.246309 31620 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.252588 31795 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.282240 31793 raft_consensus.cc:2804] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:08.227691 31798 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.278018 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:08.242862 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.288628 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.266994 31800 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:08.326507 31813 consensus_queue.cc:1048] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260807 07:57:08.246614 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:08.330058 30476 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.330404 30541 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:08.331760 31790 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.249933 31616 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:08.333956 31616 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.240233 31792 raft_consensus.cc:2804] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.337620 31792 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.338091 31792 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.253618 30578 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:08.249805 31720 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.343990 31720 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.344823 31720 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.277662 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.304003 30539 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:57:08.352092 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 48194.7us
I20260807 07:57:08.300462 30487 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:08.246063 31336 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:57:08.289146 31664 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:08.377215 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 131330us
I20260807 07:57:08.378356 31820 raft_consensus.cc:2804] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:08.378969 31820 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:08.379568 31820 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:08.311354 31675 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.313941 30478 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
W20260807 07:57:08.315171 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 59438.8us
I20260807 07:57:08.346154 31800 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:08.377121 30518 debug-util.cc:398] Leaking SignalData structure 0x7b0800122c20 after lost signal to thread 27911
I20260807 07:57:08.312669 31383 raft_consensus.cc:2468] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:08.240831 31767 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260807 07:57:08.320266 31810 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.246901 30358 rpcz_store.cc:276] 0807 07:57:06.576772 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:06.576896 (+ 124us) service_pool.cc:224] Handling call
0807 07:57:06.577257 (+ 361us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:06.582410 (+ 5153us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:06.582441 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:06.582931 (+ 490us) log.cc:844] Serialized 26 byte log entry
0807 07:57:07.878232 (+1295301us) raft_consensus.cc:1645] Marking committed up to 2
0807 07:57:07.996238 (+118006us) log.cc:844] Serialized 14 byte log entry
0807 07:57:08.141093 (+144855us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:08.151918 (+ 10825us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:08.156805 (+ 4887us) raft_consensus.cc:1685] finished
0807 07:57:08.165289 (+ 8484us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:08.173935 (+ 8646us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4770,"prepare.queue_time_us":175552,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":7404,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":10222,"thread_start_us":1485083,"threads_started":3,"wal-append.queue_time_us":322091,"wal-append.run_cpu_time_us":1914,"wal-append.run_wall_time_us":1023543}
I20260807 07:57:08.296142 31805 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.286127 31695 consensus_queue.cc:1048] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260807 07:57:08.302166 31793 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:08.397892 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 113837us
W20260807 07:57:08.399142 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 149694us
I20260807 07:57:08.244778 31766 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.289359 31729 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:08.326186 30360 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:08.307752 31798 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.216572 31818 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.318648 31768 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.356480 30541 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:08.359704 30489 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:08.361968 30482 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
W20260807 07:57:08.414510 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 58100.7us
I20260807 07:57:08.369258 30490 raft_consensus.cc:2468] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:08.390139 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.391857 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.389248 30539 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:57:08.394822 31830 log.cc:927] Time spent T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.114s user 0.000s sys 0.000s
I20260807 07:57:08.368619 31814 raft_consensus.cc:2804] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:08.405987 30542 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.415593 30541 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.415989 30539 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.394976 31767 consensus_queue.cc:1048] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260807 07:57:08.316963 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:08.419855 30479 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.386922 31811 raft_consensus.cc:2749] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 2. Current term is 3.
I20260807 07:57:08.395100 31831 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:08.414553 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.416726 30541 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:08.417330 31809 raft_consensus.cc:2804] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:08.417595 31799 raft_consensus.cc:2804] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:08.417771 31801 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.421947 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.422632 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.401347 31810 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.403993 31793 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:08.445607 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 62042.5us
I20260807 07:57:08.406155 31795 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:08.439368 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.478299 30482 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:08.479326 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.440083 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.480464 30489 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:08.440178 30590 raft_consensus.cc:2368] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3.
I20260807 07:57:08.406387 31729 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:08.395993 31790 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260807 07:57:08.419510 31814 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:08.405509 31616 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.318884 31804 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.447125 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:08.518007 30490 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:08.421141 30518 debug-util.cc:398] Leaking SignalData structure 0x7b0800144c60 after lost signal to thread 30272
I20260807 07:57:08.447475 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.521818 30478 raft_consensus.cc:2468] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:08.412214 31797 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:08.522730 31797 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.419392 31684 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:08.526098 30490 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:08.397480 31803 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.409098 31675 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:08.554257 31797 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:08.514415 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 114604us
W20260807 07:57:08.522578 30518 debug-util.cc:398] Leaking SignalData structure 0x7b080029c780 after lost signal to thread 30405
I20260807 07:57:08.439654 31801 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.434094 31809 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:08.569572 31809 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:08.562743 31616 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.569003 31801 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.576764 31803 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.583778 30221 catalog_manager.cc:5697] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:08.586319 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:08.587649 31383 raft_consensus.cc:2393] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:08.557777 31814 raft_consensus.cc:3060] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:08.472730 31831 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.590864 31836 raft_consensus.cc:2804] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.556952 31841 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260807 07:57:08.566428 31797 raft_consensus.cc:2749] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:08.589672 31616 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.610846 31836 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.624891 31836 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.565124 31675 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.447878 31810 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.601770 30479 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:08.640161 31720 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.654502 31818 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.652817 30476 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:08.658844 31766 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.668187 31831 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.620357 31616 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.683250 30480 raft_consensus.cc:2393] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:08.684182 31804 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.687964 31383 raft_consensus.cc:1275] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:08.689639 31768 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.690968 31718 consensus_queue.cc:1048] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:57:08.695501 31720 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.703421 31675 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.473737 31740 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:57:08.652540 31844 log.cc:927] Time spent T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.090s user 0.001s sys 0.000s
I20260807 07:57:08.589802 31664 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.620178 31800 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:08.630115 30518 debug-util.cc:398] Leaking SignalData structure 0x7b080029c740 after lost signal to thread 30521
I20260807 07:57:08.619170 31812 consensus_queue.cc:1059] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260807 07:57:08.716197 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 300245us
I20260807 07:57:08.717047 30539 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:08.721843 30539 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.725077 30539 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.726421 30539 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:57:08.722935 31788 consensus_meta.cc:287] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818: Time spent flushing consensus metadata: real 0.528s user 0.009s sys 0.006s
I20260807 07:57:08.733304 31768 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:08.734272 31768 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:08.734635 31768 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:08.734932 31805 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.724591 31684 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:08.725943 31675 raft_consensus.cc:2804] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:08.746922 31684 raft_consensus.cc:697] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:08.675675 31719 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.727932 31740 raft_consensus.cc:3055] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:08.723392 31800 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:08.771301 30539 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.722079 31620 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.753520 31675 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:08.772979 31800 raft_consensus.cc:697] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
W20260807 07:57:08.753966 30518 debug-util.cc:398] Leaking SignalData structure 0x7b0800316400 after lost signal to thread 30627
I20260807 07:57:08.772526 30539 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.779263 30539 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.780107 30539 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:08.775223 31842 raft_consensus.cc:2804] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.775704 31664 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:08.776407 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 376780us
I20260807 07:57:08.784003 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.747948 31788 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.773490 31735 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.786145 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:08.801137 30479 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.777329 31675 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:08.776592 31805 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.789002 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.808110 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.790304 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:08.809254 30490 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.811548 30479 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:08.791582 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:57:08.794938 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 378245us
I20260807 07:57:08.784108 30487 raft_consensus.cc:2393] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:08.794730 30317 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.771117 31740 raft_consensus.cc:740] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:08.736868 31820 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:08.784730 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.787102 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:08.842244 30482 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:08.795595 31842 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.816646 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.816913 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.817548 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.820469 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.788014 31795 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:08.823494 30490 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:08.826853 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.849536 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.827962 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.808398 31804 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:08.828657 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.834342 30539 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.857703 30586 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:08.822153 30317 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.814673 30478 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.846287 30585 raft_consensus.cc:2393] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:08.850112 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.850610 30587 raft_consensus.cc:2393] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:08.828559 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.834353 31767 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.855772 31795 raft_consensus.cc:697] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:08.862988 30590 raft_consensus.cc:2393] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:08.850842 30480 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:08.860555 31800 consensus_queue.cc:237] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.868103 31798 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.848927 31842 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:08.873593 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 51519us
W20260807 07:57:08.848479 30518 debug-util.cc:398] Leaking SignalData structure 0x7b0800323e40 after lost signal to thread 31418
I20260807 07:57:08.800812 31809 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:08.876071 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 403343us
I20260807 07:57:08.806634 31801 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.880072 30478 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:08.882709 30317 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:08.861908 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 297714us
I20260807 07:57:08.883562 30429 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.883769 30317 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.886775 30320 leader_election.cc:400] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:08.885134 30429 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.888018 30320 leader_election.cc:403] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:57:08.888584 30317 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.893452 30320 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:57:08.862571 31767 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.876981 31831 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:08.881457 31695 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:08.822809 31684 consensus_queue.cc:237] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:08.897519 31792 consensus_meta.cc:287] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818: Time spent flushing consensus metadata: real 0.559s user 0.006s sys 0.010s
I20260807 07:57:08.890097 31805 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.880990 31804 raft_consensus.cc:697] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:08.896335 30429 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:08.920509 30539 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.895295 31664 raft_consensus.cc:2804] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.924691 31664 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.914651 31788 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.901078 31767 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.889848 31841 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:08.939666 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:08.940232 30586 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.910118 31795 consensus_queue.cc:237] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:08.890281 31813 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260807 07:57:08.932718 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:08.944564 30582 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.936884 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:08.934652 30539 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.904734 31766 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:08.938969 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:08.947688 30587 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.893735 31818 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.929924 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:08.952227 30590 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:08.894402 31719 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.907898 31695 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:08.945195 30585 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.901091 31812 raft_consensus.cc:2749] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:08.947013 30539 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.920362 31805 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.930900 31831 raft_consensus.cc:697] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:08.933538 31664 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.965519 30539 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:08.966328 31845 raft_consensus.cc:2804] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.955070 31620 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:08.970105 31846 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:08.889267 31740 consensus_queue.cc:260] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.946775 30477 raft_consensus.cc:2393] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:08.976601 30587 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:08.987869 30585 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:08.957465 31818 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:08.963167 31695 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:08.945560 31841 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.970570 31809 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:08.977392 31805 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.978303 31797 raft_consensus.cc:2804] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.934973 31792 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:08.968601 31836 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.002697 31845 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:09.006268 31846 raft_consensus.cc:697] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:08.955389 31768 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:08.990286 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:09.029649 31845 raft_consensus.cc:3060] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:09.032701 30579 raft_consensus.cc:2393] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:08.997447 31853 raft_consensus.cc:2804] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:08.998191 31818 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:08.968428 31729 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:09.007604 31790 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:09.028825 30586 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:09.006299 31809 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:09.008882 31735 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.016605 31797 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:09.044737 30488 raft_consensus.cc:2393] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:09.023728 31740 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:09.033787 31803 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:09.007815 31616 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.043380 31809 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:09.053985 31809 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:09.041067 31790 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:09.054804 31790 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:09.055353 31801 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:09.047569 31797 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:09.003294 31804 consensus_queue.cc:237] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.047442 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:09.041687 31831 consensus_queue.cc:237] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.067355 31814 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.043304 31853 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:09.069655 31853 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:09.058908 30581 raft_consensus.cc:2393] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:09.065482 31836 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:09.075232 31729 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.081604 31852 raft_consensus.cc:2804] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:09.056301 31798 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.081173 31616 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:09.072249 31803 raft_consensus.cc:697] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:09.076408 30476 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:09.087252 31852 raft_consensus.cc:697] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:09.082533 31846 consensus_queue.cc:237] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.122586 31768 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:09.123502 31814 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.124509 31384 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:57:09.133476 31841 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.126418 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:09.138662 30477 raft_consensus.cc:2368] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 2. Current term is 3.
I20260807 07:57:09.118628 31820 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.125020 31845 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.164065 31336 leader_election.cc:400] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 2. Current term is 3.
I20260807 07:57:09.164534 31336 leader_election.cc:403] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 07:57:09.165712 31811 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:09.172333 31845 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.181695 31852 consensus_queue.cc:237] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:09.170490 31793 consensus_meta.cc:287] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.614s user 0.010s sys 0.005s
I20260807 07:57:09.233253 30582 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:09.160120 31841 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260807 07:57:09.175737 31803 consensus_queue.cc:237] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.237618 31845 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:09.239888 31799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s user 0.017s sys 0.056s
I20260807 07:57:09.214201 31793 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.268988 31814 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:09.269831 31814 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.271950 31792 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:09.272770 31729 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:09.273490 31729 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.274238 31814 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.276269 31729 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.278792 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:09.241515 31805 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:09.258817 31799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s user 0.017s sys 0.060s
W20260807 07:57:09.288542 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:09.288535 31799 raft_consensus.cc:697] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:09.291623 31850 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:09.263532 31675 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:57:09.302033 31810 consensus_meta.cc:287] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.623s user 0.015s sys 0.000s
I20260807 07:57:09.303124 31793 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.259574 31845 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.319554 31845 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.320377 31814 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:09.293840 31805 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.292605 31850 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.322625 30578 raft_consensus.cc:1240] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:09.321195 31814 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.331467 31675 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:09.331944 31809 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.341179 31814 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.343065 31809 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:09.349059 31799 consensus_queue.cc:237] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:09.306367 31842 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.353416 31845 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:09.354064 31845 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:09.306303 31383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s user 0.033s sys 0.075s
W20260807 07:57:09.378037 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 489489us
I20260807 07:57:09.379817 31820 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:09.313979 31810 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.395769 31820 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:09.401571 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:09.399998 31695 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.402714 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:09.403661 30476 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 1.
I20260807 07:57:09.380685 31767 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.411878 31805 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:09.412725 31805 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:09.416008 31805 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:09.417553 31766 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:09.423813 31811 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 2. Current term is 3.
I20260807 07:57:09.401212 31820 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:09.362627 31383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s user 0.033s sys 0.076s
I20260807 07:57:09.498621 30478 raft_consensus.cc:1240] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 07:57:09.500757 30482 raft_consensus.cc:1240] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 07:57:09.501902 30479 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:57:09.506841 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:09.507532 30479 raft_consensus.cc:2368] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:09.513149 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:09.513794 30490 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:09.514611 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:09.519143 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:09.519739 30479 raft_consensus.cc:3060] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:09.497566 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:09.538882 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:09.668076 30541 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.64.129:36407 timed out after 1.718s (SENT) [suppressed 64 similar messages]
I20260807 07:57:09.679165 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:09.680814 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:09.434100 31805 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:09.691692 31820 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:09.717772 31820 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:09.720664 31820 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.681947 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:09.756649 30478 raft_consensus.cc:2368] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:09.410935 31853 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:09.708878 31664 consensus_meta.cc:287] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818: Time spent flushing consensus metadata: real 0.715s user 0.009s sys 0.004s
I20260807 07:57:09.395752 31818 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:09.708022 31842 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:09.816749 31384 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:09.819933 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:09.895308 30487 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:09.726213 31805 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:09.931804 30319 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.030s user 0.029s sys 0.066s
W20260807 07:57:09.956248 30319 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.056s user 0.031s sys 0.068s
I20260807 07:57:09.737092 31695 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.991808 30490 raft_consensus.cc:2468] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
W20260807 07:57:09.876868 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:09.998700 30479 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:09.904778 30476 raft_consensus.cc:1240] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260807 07:57:09.934700 31800 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.972s user 0.018s sys 0.027s
I20260807 07:57:10.057415 31850 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:10.057900 31810 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:09.884881 31820 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:09.888561 31664 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:10.062197 31814 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:10.061877 31788 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:10.117184 31800 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.132s user 0.019s sys 0.028s
W20260807 07:57:10.120237 31790 consensus_meta.cc:287] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 1.065s user 0.012s sys 0.001s
I20260807 07:57:10.124090 31814 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:10.125150 31788 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:10.131935 30584 raft_consensus.cc:1240] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:10.134315 31788 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:10.135012 31788 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:10.135583 31788 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:10.137605 31790 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:10.151247 31790 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:10.154942 31814 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:10.155738 31814 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:10.157437 31856 log.cc:927] Time spent T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.090s user 0.000s sys 0.000s
I20260807 07:57:10.138759 31853 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:10.159057 31383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59392 (request call id 48) took 1460 ms. Trace:
I20260807 07:57:10.159511 31853 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:10.160339 31853 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:10.159844 31383 rpcz_store.cc:276] 0807 07:57:08.698329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:08.701460 (+ 3131us) service_pool.cc:224] Handling call
0807 07:57:08.701915 (+ 455us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:08.702781 (+ 866us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:08.702845 (+ 64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:08.703868 (+ 1023us) log.cc:844] Serialized 26 byte log entry
0807 07:57:09.683604 (+979736us) raft_consensus.cc:1645] Marking committed up to 4
0807 07:57:09.692237 (+ 8633us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:09.707237 (+ 15000us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:10.158605 (+451368us) raft_consensus.cc:1685] finished
0807 07:57:10.158642 (+ 37us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:10.158907 (+ 265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":167,"thread_start_us":730477,"threads_started":1,"wal-append.queue_time_us":1264880}
I20260807 07:57:10.139942 31805 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:10.139014 31788 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:10.141567 31818 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:10.141940 31767 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:10.143399 31664 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:10.156368 31814 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:10.121176 31820 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:10.181874 31820 leader_election.cc:290] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:10.187872 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:10.188946 30480 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:10.200935 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:10.201632 30366 raft_consensus.cc:2468] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 1.
I20260807 07:57:10.201925 31853 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:10.164693 31797 consensus_meta.cc:287] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 1.089s user 0.004s sys 0.008s
I20260807 07:57:10.203287 31797 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:10.204190 31845 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:09.497825 30320 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s user 0.039s sys 0.051s
W20260807 07:57:10.205335 30320 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.305s user 0.049s sys 0.079s
W20260807 07:57:10.205662 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 1.30581e+06us
I20260807 07:57:10.207135 31797 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:10.169169 31814 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:09.975353 31715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.068s user 0.026s sys 0.069s
W20260807 07:57:10.219754 31804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.095s user 0.020s sys 0.024s
W20260807 07:57:10.220891 31715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.313s user 0.026s sys 0.073s
W20260807 07:57:10.258081 31804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.134s user 0.020s sys 0.025s
W20260807 07:57:10.259680 31795 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.976s user 0.019s sys 0.019s
W20260807 07:57:10.262696 31839 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.665s user 0.062s sys 0.092s
W20260807 07:57:10.994702 31839 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.397s user 0.062s sys 0.092s
W20260807 07:57:10.825682 31795 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.542s user 0.020s sys 0.019s
W20260807 07:57:11.106902 31803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.743s user 0.002s sys 0.040s
W20260807 07:57:11.107519 31803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.744s user 0.002s sys 0.040s
W20260807 07:57:11.108350 31831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.757s user 0.012s sys 0.042s
W20260807 07:57:11.108781 31831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.760s user 0.013s sys 0.042s
W20260807 07:57:11.417814 31684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.223s user 0.000s sys 0.044s
W20260807 07:57:11.418423 31684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.232s user 0.000s sys 0.044s
W20260807 07:57:11.419330 31852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.149s user 0.018s sys 0.026s
W20260807 07:57:11.419782 31852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.150s user 0.018s sys 0.026s
W20260807 07:57:11.420552 31846 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.166s user 0.034s sys 0.089s
W20260807 07:57:11.420946 31846 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.166s user 0.034s sys 0.090s
W20260807 07:57:11.421540 31860 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.717s user 0.007s sys 0.035s
W20260807 07:57:11.421969 31860 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.724s user 0.008s sys 0.035s
W20260807 07:57:11.457401 31799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.574s user 0.002s sys 0.010s
W20260807 07:57:11.457836 31799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.575s user 0.002s sys 0.010s
I20260807 07:57:11.467653 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:11.468385 30358 raft_consensus.cc:2468] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 1.
I20260807 07:57:11.469007 30358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33338 (request call id 12) took 1457 ms. Trace:
I20260807 07:57:11.470211 30358 rpcz_store.cc:276] 0807 07:57:10.011226 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:11.467336 (+1456110us) service_pool.cc:224] Handling call
0807 07:57:11.468942 (+ 1606us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260807 07:57:11.480286 30539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.502s user 0.019s sys 0.049s
W20260807 07:57:11.480625 30539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.502s user 0.019s sys 0.049s
W20260807 07:57:11.480880 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 2.51519e+06us
I20260807 07:57:11.486690 30539 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:11.487524 31846 raft_consensus.cc:2804] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:11.487890 31846 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:11.488193 31846 raft_consensus.cc:3060] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:11.497133 31384 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59392 (request call id 49) took 2219 ms (client timeout 1523 ms). Trace:
W20260807 07:57:11.499150 31384 rpcz_store.cc:269] 0807 07:57:09.277883 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:09.278461 (+ 578us) service_pool.cc:224] Handling call
0807 07:57:11.496908 (+2218447us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54006a0254. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:11.497043 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335083392}
I20260807 07:57:11.500717 31846 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.544878 30317 leader_election.cc:400] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:11.545199 30317 leader_election.cc:403] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 07:57:11.545814 31846 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:11.504371 31852 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:11.546629 31849 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:11.546553 31852 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.548602 31852 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:11.504951 31684 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:11.549220 31684 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.550027 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:11.505559 31831 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:11.551163 31831 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.553049 31831 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:11.506120 31803 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:11.553689 31803 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.555560 31803 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:11.506726 31871 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:11.556138 31871 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.507313 31868 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:11.507881 31795 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:11.560969 31795 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.556499 31849 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:11.562889 31795 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:11.511776 31813 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:11.563702 31813 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.565639 31813 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:11.512216 31906 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:11.566280 31906 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.513541 31847 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:11.513970 31793 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:11.515148 31740 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:11.515576 31729 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:11.585587 31906 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:11.516152 31841 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:11.583815 31847 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.587127 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:11.518574 31903 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:11.588282 31903 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.591594 30477 raft_consensus.cc:1240] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 07:57:11.519024 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:11.520936 30366 raft_consensus.cc:1275] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:11.521160 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:11.521452 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:11.523737 31695 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:11.526564 31810 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:11.611750 31810 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.531483 31907 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:11.626469 31907 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.627200 31810 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:11.628509 31907 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:11.533970 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:11.536294 31715 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:11.630218 31715 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.525190 31850 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:11.631974 31850 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.633096 31715 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:11.633833 31850 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:11.538166 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:11.540602 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:11.635558 30365 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:11.636243 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:11.636827 30372 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:11.557947 31868 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.639899 31868 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:11.558343 30317 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:11.559262 30427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.497s user 0.002s sys 0.038s
W20260807 07:57:11.640952 30427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.578s user 0.003s sys 0.038s
I20260807 07:57:11.642155 31839 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:11.559909 31871 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:11.642613 31839 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.644098 31897 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:11.644646 31839 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:11.644599 31897 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:11.645285 31839 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:11.646347 31839 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.646839 31897 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:11.560495 31684 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:11.583894 31793 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.649622 31839 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:11.610730 30363 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:11.651435 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 93167.1us
I20260807 07:57:11.652189 30317 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:11.592898 30358 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:11.594884 30369 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:11.654948 31841 raft_consensus.cc:2749] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:11.655203 31813 consensus_queue.cc:1059] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:11.656023 31906 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:11.656637 31813 raft_consensus.cc:3055] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:11.657029 31813 raft_consensus.cc:740] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:11.594432 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:57:11.528606 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 1.32226e+06us
I20260807 07:57:11.657814 30366 raft_consensus.cc:2393] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:11.657889 30320 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:11.659085 30320 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:11.660163 30320 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:11.610347 31740 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.588292 31847 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:11.613847 31903 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:11.613572 31695 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.613862 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33928 (request call id 548) took 2097 ms. Trace:
W20260807 07:57:11.594316 30360 consensus_meta.cc:287] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 2.175s user 0.011s sys 0.011s
I20260807 07:57:11.595116 30367 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:11.649741 31793 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:11.585990 31729 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.648097 30365 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:11.657182 30317 leader_election.cc:400] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:11.662856 30320 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:11.663290 30372 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:11.658200 31813 consensus_queue.cc:260] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:11.944444 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 281626us
I20260807 07:57:11.945438 30320 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:11.950091 31914 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:11.670744 30477 rpcz_store.cc:276] 0807 07:57:09.494630 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:09.531352 (+ 36722us) service_pool.cc:224] Handling call
0807 07:57:11.591036 (+2059684us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b5800091898. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b83d2 00007fd6bb124219 00007fd6ba277640 00007fd6ba33febb 00007fd6ba33ff41 00007fd6ba301dd0 00007fd6ba2ec739 00007fd6ba2ec1e2 00007fd6b3831d34
0807 07:57:11.591289 (+ 253us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:11.592070 (+ 781us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:11.592372 (+ 302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10747648}
I20260807 07:57:11.966255 31914 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.666927 31715 raft_consensus.cc:2749] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:11.681811 30369 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:11.663219 31810 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:11.664189 31849 raft_consensus.cc:2749] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:11.666726 31841 raft_consensus.cc:2749] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:11.737063 30367 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:11.942148 30317 leader_election.cc:403] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260807 07:57:11.984737 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 328815us
I20260807 07:57:11.985771 30317 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:11.900524 31839 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:11.683027 31740 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:11.671388 30360 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 2.
I20260807 07:57:11.992362 31873 raft_consensus.cc:2804] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:11.990976 31715 raft_consensus.cc:2749] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:11.950610 31793 raft_consensus.cc:2749] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:11.950763 31850 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:11.680540 31695 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:11.911375 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 86334.1us
I20260807 07:57:11.968470 31914 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:11.976145 31847 consensus_queue.cc:1059] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260807 07:57:11.994808 31873 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:12.007421 31873 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:12.014201 31338 leader_election.cc:304] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters: f831a53ec51d452398015797d543164e
I20260807 07:57:11.994362 30317 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:12.016335 30317 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:12.017957 31715 raft_consensus.cc:2804] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:12.018599 31715 raft_consensus.cc:697] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:12.019462 31715 consensus_queue.cc:237] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:11.677346 30363 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:11.995335 31839 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.001303 31740 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:12.002961 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:11.985399 31810 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.026726 30578 raft_consensus.cc:2393] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:12.005450 30584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34604 (request call id 516) took 3189 ms. Trace:
I20260807 07:57:11.991962 31813 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:12.018033 31845 raft_consensus.cc:2804] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:11.998509 31729 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.025760 31740 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:12.004468 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:12.028282 30584 rpcz_store.cc:276] 0807 07:57:08.816050 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:08.818461 (+ 2411us) service_pool.cc:224] Handling call
0807 07:57:08.847614 (+ 29153us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:10.132607 (+1284993us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:11.997358 (+1864751us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400187754. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:12.005337 (+ 7979us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2944931584}
I20260807 07:57:12.031879 31740 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.037779 30221 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53656 (request call id 200) took 3634 ms. Trace:
I20260807 07:57:12.038172 30221 rpcz_store.cc:276] 0807 07:57:08.421609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:08.433395 (+ 11786us) service_pool.cc:224] Handling call
0807 07:57:12.037696 (+3604301us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:09.306517 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:09.335001 (+ 28484us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:09.335043 (+ 42us) write_op.cc:435] Acquired schema lock
0807 07:57:09.335071 (+ 28us) tablet.cc:662] Decoding operations
0807 07:57:09.336762 (+ 1691us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:09.336849 (+ 87us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:09.336892 (+ 43us) tablet.cc:685] Acquiring locks for 1 operations
0807 07:57:09.337189 (+ 297us) tablet.cc:701] Row locks acquired
0807 07:57:09.337215 (+ 26us) write_op.cc:260] PREPARE: finished
0807 07:57:09.337488 (+ 273us) write_op.cc:270] Start()
0807 07:57:09.337669 (+ 181us) write_op.cc:276] Timestamp: P: 1786089429337399 usec, L: 0
0807 07:57:09.337693 (+ 24us) op_driver.cc:348] REPLICATION: starting
0807 07:57:09.428547 (+ 90854us) log.cc:844] Serialized 535 byte log entry
0807 07:57:11.463987 (+2035440us) op_driver.cc:464] REPLICATION: finished
0807 07:57:11.466755 (+ 2768us) write_op.cc:301] APPLY: starting
0807 07:57:11.466840 (+ 85us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:11.466939 (+ 99us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:11.467075 (+ 136us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:11.467268 (+ 193us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:11.467424 (+ 156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 07:57:11.467465 (+ 41us) write_op.cc:312] APPLY: finished
0807 07:57:11.467674 (+ 209us) log.cc:844] Serialized 22 byte log entry
0807 07:57:11.467838 (+ 164us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:11.467919 (+ 81us) write_op.cc:454] Released schema lock
0807 07:57:11.467954 (+ 35us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:11.469651 (+ 1697us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:11.469686 (+ 35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":2537,"apply.run_cpu_time_us":1487,"apply.run_wall_time_us":1487,"num_ops":1,"prepare.queue_time_us":655506,"prepare.run_cpu_time_us":48901,"prepare.run_wall_time_us":2150925,"raft.queue_time_us":419329,"raft.run_cpu_time_us":2271,"raft.run_wall_time_us":6197,"replication_time_us":2126106,"thread_start_us":2456334,"threads_started":4,"wal-append.queue_time_us":1592186}]]}
I20260807 07:57:12.043881 31845 raft_consensus.cc:697] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
W20260807 07:57:12.044521 30542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.110s user 0.031s sys 0.093s
W20260807 07:57:12.044898 30542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.111s user 0.031s sys 0.093s
I20260807 07:57:12.044796 31845 consensus_queue.cc:237] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.046492 31839 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.047017 31913 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:12.047513 31913 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.049980 31913 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:12.050458 31913 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:12.050877 31913 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.052301 31385 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 LEARNER]: Advancing to term 3
I20260807 07:57:12.052867 31913 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.054109 31873 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.056514 31873 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.060988 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.061226 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.061493 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.062207 30365 raft_consensus.cc:2393] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:12.063180 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.063445 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.064179 30372 raft_consensus.cc:2393] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:12.063999 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.064589 30373 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:12.066133 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.068306 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.068557 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.068845 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.069437 30373 raft_consensus.cc:2393] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:12.073210 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.075309 30369 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:12.072786 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.077371 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.078585 30366 raft_consensus.cc:2393] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:12.078498 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.079202 30369 raft_consensus.cc:2393] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:12.079928 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.080005 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.080788 30373 raft_consensus.cc:2393] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:12.081313 31795 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:12.081609 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.080893 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.067893 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.083577 31795 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.083988 30480 raft_consensus.cc:2468] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 3.
I20260807 07:57:12.065217 31903 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:12.065011 31740 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:12.095988 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.085098 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.097687 30372 raft_consensus.cc:2393] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:12.082267 31913 raft_consensus.cc:2804] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:12.098948 31915 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:12.081216 31873 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:12.082957 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.082559 31907 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:12.105160 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.103099 31915 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.105928 30372 raft_consensus.cc:2393] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
W20260807 07:57:12.082116 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 63837.4us
I20260807 07:57:12.097025 31903 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.098182 31740 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.102676 31336 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:12.109234 30367 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:12.106685 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.110230 31740 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.110522 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.101279 31913 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:12.111102 30372 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:12.111627 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 77664.8us
I20260807 07:57:12.105122 30363 raft_consensus.cc:2468] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:12.106956 31810 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.110571 31385 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:57:12.114598 31916 raft_consensus.cc:2804] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:12.119393 31916 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:12.119738 31916 raft_consensus.cc:3060] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:12.120702 31903 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:12.121075 31799 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:12.121685 31915 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.123369 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.123986 30480 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 3.
I20260807 07:57:12.124202 31795 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:12.119663 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.125396 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.126466 30363 raft_consensus.cc:2393] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
W20260807 07:57:12.132692 30360 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33338 (request call id 10) took 3089 ms (client timeout 1943 ms). Trace:
I20260807 07:57:12.136435 30372 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
W20260807 07:57:12.133111 30360 rpcz_store.cc:269] 0807 07:57:09.043504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:09.045363 (+ 1859us) service_pool.cc:224] Handling call
0807 07:57:12.132525 (+3087162us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54003b9554. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:12.132626 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":810157952}
I20260807 07:57:12.114310 31913 raft_consensus.cc:3060] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.117792 31338 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters: f831a53ec51d452398015797d543164e
W20260807 07:57:12.142956 31382 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.738s user 0.028s sys 0.019s
I20260807 07:57:12.143136 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.143797 30360 raft_consensus.cc:2468] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 3.
I20260807 07:57:12.144812 31906 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:12.145830 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.104799 31873 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.145242 31906 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:12.149209 31913 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:12.149930 31382 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.745s user 0.028s sys 0.019s
I20260807 07:57:12.150779 31382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59320 (request call id 22) took 2758 ms. Trace:
I20260807 07:57:12.151355 31913 leader_election.cc:290] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.151449 31912 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:12.152050 31912 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.151120 31382 rpcz_store.cc:276] 0807 07:57:09.392967 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:09.393174 (+ 207us) service_pool.cc:224] Handling call
0807 07:57:09.394130 (+ 956us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:09.394673 (+ 543us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:09.394711 (+ 38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:09.397335 (+ 2624us) log.cc:844] Serialized 564 byte log entry
0807 07:57:12.150373 (+2753038us) raft_consensus.cc:1645] Marking committed up to 2
0807 07:57:12.150416 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:12.150499 (+ 83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:12.150552 (+ 53us) raft_consensus.cc:1685] finished
0807 07:57:12.150569 (+ 17us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:12.150703 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":2745680,"threads_started":1,"wal-append.queue_time_us":1634520,"wal-append.run_cpu_time_us":1549,"wal-append.run_wall_time_us":1001581}
I20260807 07:57:12.112358 31907 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.157415 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.158080 30584 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 2.
I20260807 07:57:12.148787 31915 raft_consensus.cc:2804] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:12.158946 31915 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:12.159289 31915 raft_consensus.cc:3060] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.161612 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.162254 30360 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 2.
I20260807 07:57:12.167797 31915 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.167800 31906 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.170115 31906 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.171808 31766 raft_consensus.cc:3055] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:12.172226 31766 raft_consensus.cc:740] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:12.173256 31907 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:12.177543 31915 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:12.185679 30429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.242s user 0.030s sys 0.107s
I20260807 07:57:12.173136 31766 consensus_queue.cc:260] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:12.186599 30429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.243s user 0.030s sys 0.107s
I20260807 07:57:12.188344 30220 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53640 (request call id 170) took 2549 ms. Trace:
I20260807 07:57:12.188804 30220 rpcz_store.cc:276] 0807 07:57:09.639119 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:11.454842 (+1815723us) service_pool.cc:224] Handling call
0807 07:57:12.188275 (+733433us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":461141,"reported_tablets":4}
I20260807 07:57:12.198874 31914 consensus_queue.cc:1048] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:12.171759 31916 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.201251 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.201828 31916 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.202943 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.203616 30365 raft_consensus.cc:2368] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:12.204159 30369 raft_consensus.cc:2393] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:12.205328 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:57:12.205562 30489 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.448s user 0.037s sys 0.024s
W20260807 07:57:12.207147 30489 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.450s user 0.038s sys 0.024s
I20260807 07:57:12.207321 30477 raft_consensus.cc:3060] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:12.208035 30489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33928 (request call id 556) took 2710 ms. Trace:
I20260807 07:57:12.208461 31873 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.208387 30489 rpcz_store.cc:276] 0807 07:57:09.497112 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:09.503691 (+ 6579us) service_pool.cc:224] Handling call
0807 07:57:09.504177 (+ 486us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:09.504510 (+ 333us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:09.504535 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:09.550171 (+ 45636us) log.cc:844] Serialized 564 byte log entry
0807 07:57:12.207693 (+2657522us) raft_consensus.cc:1645] Marking committed up to 2
0807 07:57:12.207737 (+ 44us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:12.207807 (+ 70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:12.207846 (+ 39us) raft_consensus.cc:1685] finished
0807 07:57:12.207856 (+ 10us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:12.207959 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":2450494,"threads_started":1,"wal-append.queue_time_us":1364221,"wal-append.run_cpu_time_us":1964,"wal-append.run_wall_time_us":1001987}
I20260807 07:57:12.210776 30429 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:12.213192 31923 raft_consensus.cc:2749] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:12.214367 30429 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:12.215143 31923 raft_consensus.cc:2804] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:12.215513 31923 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:12.215874 31923 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.216147 30221 catalog_manager.cc:5697] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 3, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260807 07:57:12.206563 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 49184.3us
W20260807 07:57:12.220168 30541 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.527s user 0.028s sys 0.030s
W20260807 07:57:12.221045 30541 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.528s user 0.028s sys 0.030s
W20260807 07:57:12.221361 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 2.55312e+06us
I20260807 07:57:12.222922 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.222939 30429 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:12.224692 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.229106 30367 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:12.229591 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.229991 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.230335 30360 raft_consensus.cc:2393] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:12.230489 30365 raft_consensus.cc:2393] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:12.231285 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.231393 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:57:12.232270 30428 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.169s user 0.015s sys 0.040s
W20260807 07:57:12.232682 30428 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.170s user 0.015s sys 0.040s
I20260807 07:57:12.232581 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.233089 30363 raft_consensus.cc:1275] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 07:57:12.233625 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.232285 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.234601 30365 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:12.224328 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.234753 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.235615 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.236670 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.236791 31914 raft_consensus.cc:2804] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:12.237329 30372 raft_consensus.cc:2393] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:12.237850 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.238078 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.237193 31914 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:12.239328 31914 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.230731 31338 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.240573 31338 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:12.221071 30221 catalog_manager.cc:5697] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:12.239521 30363 pending_rounds.cc:85] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19: Aborting all ops after (but not including) 1
I20260807 07:57:12.243074 31912 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.243332 30363 pending_rounds.cc:107] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 07:57:12.243638 30363 raft_consensus.cc:2889] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:12.239295 30372 raft_consensus.cc:3055] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:12.248711 30372 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:12.237876 31906 consensus_queue.cc:1059] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260807 07:57:12.249766 31915 raft_consensus.cc:2804] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:12.245100 30221 catalog_manager.cc:5697] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 2 to 3, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:12.250204 31915 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:12.251883 31915 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:12.242852 31907 raft_consensus.cc:1064] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
W20260807 07:57:12.252642 31907 raft_consensus.cc:1068] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: Unable to promote non-voter 6bd20e9c0d3e4ace86fc1f55ab9425fa: Illegal state: Leader has not yet committed an operation in its own term
I20260807 07:57:12.247100 31813 consensus_queue.cc:1059] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:12.248188 31839 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:12.256601 31839 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.246522 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.235677 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.251143 30221 catalog_manager.cc:5697] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 2 to 3, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:12.265587 30489 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 1.
I20260807 07:57:12.268304 31839 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.260257 31916 raft_consensus.cc:2804] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:12.316874 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:12.312105 30430 connection.cc:256] RPC call timeout handler was delayed by -1.6264184969477355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
I20260807 07:57:12.269418 30221 catalog_manager.cc:5697] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 3, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:12.270107 31916 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:12.323969 31916 raft_consensus.cc:3060] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:12.324183 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:12.310089 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.278991 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:12.325011 30367 raft_consensus.cc:2376] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 2. Re-sending same reply.
I20260807 07:57:12.325161 31385 raft_consensus.cc:2393] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 4: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:57:12.269661 31839 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:12.325354 31795 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:12.326098 31795 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.321259 31766 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.328308 30360 raft_consensus.cc:3055] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:12.328747 30360 raft_consensus.cc:740] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:12.281464 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:12.331014 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.282864 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:12.331831 30489 raft_consensus.cc:2368] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:12.328534 31839 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.333269 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.284261 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.277789 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.334683 30489 raft_consensus.cc:2393] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:12.334877 30366 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:12.334472 30581 raft_consensus.cc:2393] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:12.336323 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.291466 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.336959 30489 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:12.315124 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 87308.5us
W20260807 07:57:12.337941 30541 connection.cc:256] RPC call timeout handler was delayed by -2.4681482180021703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260807 07:57:12.338429 30541 connection.cc:256] RPC call timeout handler was delayed by -2.4474482180085033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260807 07:57:12.339006 30541 connection.cc:256] RPC call timeout handler was delayed by -2.4350088851060718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260807 07:57:12.339356 30541 connection.cc:256] RPC call timeout handler was delayed by -2.4296088849660009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
I20260807 07:57:12.324268 30221 catalog_manager.cc:5697] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 2 to 3, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:12.344053 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.344318 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.345463 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.345986 30479 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:12.346635 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.347153 30482 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:12.317749 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:12.335013 31907 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:12.334784 31903 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:12.328320 31795 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:12.359601 30490 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:12.370479 30482 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:12.341629 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.371426 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.353292 30366 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:12.272572 30477 raft_consensus.cc:2468] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 4.
I20260807 07:57:12.374120 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.375337 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.375974 30477 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:12.376910 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.378224 31336 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:57:12.379534 31912 raft_consensus.cc:2804] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:12.380054 31912 raft_consensus.cc:697] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:57:12.364890 30479 raft_consensus.cc:2468] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:12.366192 31338 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:12.382167 30539 leader_election.cc:400] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:12.382483 30539 leader_election.cc:403] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 07:57:12.360231 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.283252 31923 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.280522 31914 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.277465 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.353912 30360 consensus_queue.cc:260] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.387527 31338 leader_election.cc:304] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:12.308732 31928 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:12.372440 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.390942 30482 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:12.371028 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.391551 30490 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:12.391642 30489 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:12.392396 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.392580 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.393054 30490 raft_consensus.cc:2393] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:12.373168 30480 raft_consensus.cc:2393] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
W20260807 07:57:12.384111 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 161231us
I20260807 07:57:12.384593 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.393795 30479 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:12.394337 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.394626 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.395601 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:12.396369 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:12.396631 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.397276 30490 raft_consensus.cc:2393] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:12.398373 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.398524 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.399092 30490 raft_consensus.cc:2368] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:12.399173 30489 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:12.399614 30429 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:12.395330 30479 raft_consensus.cc:2393] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:12.400141 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.401289 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.388391 30360 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:12.407968 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.408643 30479 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:12.409550 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.410606 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.411139 30479 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:12.411896 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.412871 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.414418 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.414868 30482 raft_consensus.cc:2393] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 2: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:12.348587 31915 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.408218 30489 raft_consensus.cc:2393] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:12.388571 31913 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.415468 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.406884 31927 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:12.407174 31928 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.420835 30490 raft_consensus.cc:2393] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:12.417071 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.386427 31930 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:12.407454 30579 raft_consensus.cc:2393] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:12.370733 31907 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.424849 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.422485 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.372771 31903 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.418349 30476 raft_consensus.cc:2368] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:12.380971 31912 consensus_queue.cc:237] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.426928 30490 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:12.431366 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.431964 30490 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:12.432821 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.433923 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.434563 30490 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:12.425936 30479 raft_consensus.cc:2393] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:12.437516 30478 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.426644 30317 leader_election.cc:400] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:12.437988 30317 leader_election.cc:403] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 07:57:12.439216 30429 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:12.440263 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.440948 30479 raft_consensus.cc:2393] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
W20260807 07:57:12.442566 30541 connection.cc:256] RPC call timeout handler was delayed by -2.2368482181336731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260807 07:57:12.442214 30317 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:12.444363 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:12.443547 30541 connection.cc:256] RPC call timeout handler was delayed by -2.1756482180207968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
I20260807 07:57:12.445003 30479 raft_consensus.cc:2393] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:12.429265 31795 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:12.445690 31795 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.443013 31839 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.447521 31923 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.448957 31923 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:12.450870 31914 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.439733 31930 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.425323 31927 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.437153 31846 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:12.454200 31846 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.455518 31928 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:12.427232 31940 raft_consensus.cc:2749] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:12.459204 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:12.462193 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.462880 30582 raft_consensus.cc:2393] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:12.463798 31799 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:12.444909 30541 connection.cc:256] RPC call timeout handler was delayed by -2.1243482180871069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260807 07:57:12.467372 30541 connection.cc:256] RPC call timeout handler was delayed by -2.0912088849581778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24340000000000003s for a response
W20260807 07:57:12.467789 30541 connection.cc:256] RPC call timeout handler was delayed by -2.02466331794858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260807 07:57:12.468214 30541 connection.cc:256] RPC call timeout handler was delayed by -1.9958633179776371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
W20260807 07:57:12.468497 30541 connection.cc:256] RPC call timeout handler was delayed by -1.9562633179593831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
W20260807 07:57:12.468775 30541 connection.cc:256] RPC call timeout handler was delayed by -1.9391633181367069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260807 07:57:12.469048 30541 connection.cc:256] RPC call timeout handler was delayed by -1.9382633180357516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260807 07:57:12.469319 30541 connection.cc:256] RPC call timeout handler was delayed by -1.850963318021968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260807 07:57:12.438714 30477 raft_consensus.cc:2393] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 2: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
W20260807 07:57:12.470278 30541 connection.cc:256] RPC call timeout handler was delayed by -1.8347633180674165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
W20260807 07:57:12.471019 30541 connection.cc:256] RPC call timeout handler was delayed by -1.8338633179664612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
W20260807 07:57:12.471419 30541 connection.cc:256] RPC call timeout handler was delayed by -1.8176633180119097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
I20260807 07:57:12.472507 31740 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:12.472903 31740 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:12.473543 30372 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.474601 30372 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:12.475037 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.475683 31799 raft_consensus.cc:2749] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:12.441444 31847 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:12.463822 31916 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.478217 31916 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:12.478406 30489 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:12.478947 31933 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:12.479403 31933 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.480124 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.480808 30489 raft_consensus.cc:2393] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:12.476747 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:12.471777 30541 connection.cc:256] RPC call timeout handler was delayed by -1.6268633180297911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
W20260807 07:57:12.482717 30541 connection.cc:256] RPC call timeout handler was delayed by -1.4783633181359619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
I20260807 07:57:12.482640 30585 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 1.
W20260807 07:57:12.483273 30541 connection.cc:256] RPC call timeout handler was delayed by -1.4144088849425316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3186s for a response
W20260807 07:57:12.483616 30541 connection.cc:256] RPC call timeout handler was delayed by -1.3240744899958372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
W20260807 07:57:12.484175 30541 connection.cc:256] RPC call timeout handler was delayed by -1.2548369520809501s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2218s for a response
I20260807 07:57:12.482613 30478 raft_consensus.cc:2410] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260807 07:57:12.484664 30541 connection.cc:256] RPC call timeout handler was delayed by -1.1884244561661035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
I20260807 07:57:12.471071 30317 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:12.485476 30541 connection.cc:256] RPC call timeout handler was delayed by -1.1732633181381971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24620000000000003s for a response
W20260807 07:57:12.485852 30541 connection.cc:256] RPC call timeout handler was delayed by -1.1624633180908859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24740000000000004s for a response
I20260807 07:57:12.486860 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.487437 30585 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:12.488633 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.488790 30585 raft_consensus.cc:1240] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 07:57:12.489806 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.490005 30581 raft_consensus.cc:1240] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 07:57:12.490859 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.491380 30581 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:12.492106 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:12.492194 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.492748 30581 raft_consensus.cc:2368] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:12.489183 30586 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:12.493207 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:12.493450 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.493947 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.493103 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:12.495028 30585 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260807 07:57:12.493918 30590 raft_consensus.cc:2393] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:12.495373 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.490880 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:12.496811 30587 raft_consensus.cc:2393] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:12.481359 31933 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:12.498402 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.499186 30579 raft_consensus.cc:2393] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:12.499342 31903 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:12.498524 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.500789 30584 raft_consensus.cc:2393] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:12.496155 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:12.496863 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.501868 30360 raft_consensus.cc:1275] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 07:57:12.481602 31338 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:12.502398 30489 raft_consensus.cc:2393] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:12.504065 31916 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:12.505336 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.505896 30373 raft_consensus.cc:3060] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:12.506562 30489 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:12.507486 30482 raft_consensus.cc:1275] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:12.507666 30489 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:12.507862 31839 raft_consensus.cc:2764] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260807 07:57:12.508813 30489 raft_consensus.cc:1240] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:12.499996 31795 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:12.498175 31846 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:12.502238 30360 pending_rounds.cc:85] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19: Aborting all ops after (but not including) 1
I20260807 07:57:12.512005 30360 pending_rounds.cc:107] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 07:57:12.512303 30360 raft_consensus.cc:2889] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:12.473240 31740 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:12.514907 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 43902.5us
I20260807 07:57:12.484216 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:12.475805 30480 raft_consensus.cc:2393] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:12.534173 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:12.535102 30581 raft_consensus.cc:2393] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:12.481626 31385 raft_consensus.cc:1240] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:12.518827 30490 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:12.519820 30373 raft_consensus.cc:2468] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 4.
I20260807 07:57:12.478041 31927 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.502270 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:12.538697 30585 raft_consensus.cc:2368] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:12.539799 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.540364 30582 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:12.498288 31907 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:12.531435 31906 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260807 07:57:12.531809 30372 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 07:57:12.545851 30372 pending_rounds.cc:85] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19: Aborting all ops after (but not including) 1
I20260807 07:57:12.546130 30372 pending_rounds.cc:107] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 07:57:12.543417 30317 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:12.543870 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.546847 30582 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:12.546904 30317 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:12.530997 30479 raft_consensus.cc:2393] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:12.546392 30372 raft_consensus.cc:2889] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:12.546489 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.532963 31841 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:12.551589 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.553802 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.552212 30582 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
W20260807 07:57:12.555497 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 130624us
I20260807 07:57:12.537319 31930 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.564874 30317 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:12.601011 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:12.552716 31813 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
W20260807 07:57:12.613637 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 57311.4us
I20260807 07:57:12.551220 31766 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 07:57:12.614151 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 49345.1us
I20260807 07:57:12.624552 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.551041 31847 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:12.552193 31841 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:12.632470 31382 raft_consensus.cc:1240] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:12.634747 31913 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:12.551453 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:12.635490 30539 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.642011 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:12.710784 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 75372.5us
I20260807 07:57:12.628499 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.711679 30539 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.711723 30585 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:12.638128 31849 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:12.713635 30578 raft_consensus.cc:2368] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:12.714625 31942 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:12.642673 31847 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:12.715165 31942 raft_consensus.cc:697] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 2 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:12.715308 31847 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.716089 31942 consensus_queue.cc:237] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.718941 31384 raft_consensus.cc:1240] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:12.720167 31846 raft_consensus.cc:2804] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:12.720662 31846 raft_consensus.cc:697] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:12.720750 30539 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.721658 30539 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.721524 31846 consensus_queue.cc:237] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.722158 31933 consensus_queue.cc:1059] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:12.722518 30539 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.722895 31868 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:12.723281 31868 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:12.723364 31907 raft_consensus.cc:2804] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:12.723618 31868 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:12.724255 31907 raft_consensus.cc:697] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:12.693576 31841 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.725183 31907 consensus_queue.cc:237] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.723656 31795 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:12.728686 31795 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:12.729031 31795 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.643473 31766 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:12.729715 31903 consensus_queue.cc:1059] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:12.730172 31766 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:12.731464 31903 raft_consensus.cc:3055] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:12.731797 31903 raft_consensus.cc:740] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:12.732637 31903 consensus_queue.cc:260] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.711763 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.734370 30539 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.735051 30581 raft_consensus.cc:2393] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:12.736369 30539 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.733880 31915 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.723874 31849 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:12.737577 31937 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:12.736068 31903 raft_consensus.cc:3060] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.553191 31338 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
W20260807 07:57:12.740366 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 194410us
I20260807 07:57:12.741062 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:12.741678 30487 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:12.742200 31915 raft_consensus.cc:2804] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:12.742702 31915 raft_consensus.cc:697] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:57:12.743506 31915 consensus_queue.cc:237] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.745870 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.746441 30372 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 4
I20260807 07:57:12.746847 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.747383 30586 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:12.748301 30541 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:12.748845 30588 raft_consensus.cc:1240] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260807 07:57:12.749694 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.750247 30582 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:12.750283 30579 raft_consensus.cc:1275] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:12.752342 31933 raft_consensus.cc:3055] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:12.752745 31933 raft_consensus.cc:740] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:12.754359 30487 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 4.
I20260807 07:57:12.759236 30372 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 4.
I20260807 07:57:12.755658 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:12.755358 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.763851 30539 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.737687 31849 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:12.737406 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:12.784824 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 345655us
I20260807 07:57:12.760135 31937 raft_consensus.cc:697] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:12.789709 30429 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:12.792591 30429 leader_election.cc:400] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3.
I20260807 07:57:12.792960 30429 leader_election.cc:403] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:57:12.774055 31871 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:12.796777 31839 raft_consensus.cc:2804] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:12.799816 31839 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:12.800159 31839 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.803877 31939 consensus_queue.cc:1059] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:12.807250 31847 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.807570 31740 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.807267 31839 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.811318 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:12.811902 31382 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.812597 31868 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.814615 31937 consensus_queue.cc:237] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.786942 31383 raft_consensus.cc:1240] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
W20260807 07:57:12.817821 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 124727us
W20260807 07:57:12.819698 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 55933.9us
I20260807 07:57:12.819819 30429 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.820657 30429 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.820879 30539 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.789420 31944 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:12.821835 30429 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.882423 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:12.823065 31839 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:12.823128 31336 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:12.884611 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 63215.6us
I20260807 07:57:12.796972 31930 raft_consensus.cc:2749] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3.
I20260807 07:57:12.867899 30539 leader_election.cc:400] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:12.887885 30539 leader_election.cc:403] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 07:57:12.886003 30429 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.785792 31933 consensus_queue.cc:260] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:12.797801 31871 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:12.822822 31931 raft_consensus.cc:3055] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:12.873575 31382 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:12.878811 31766 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.895521 31841 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:12.890686 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 92408.4us
I20260807 07:57:12.897372 31841 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.876775 31846 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:12.898000 31846 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:12.898423 31846 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:12.875895 31813 consensus_queue.cc:1059] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260807 07:57:12.899451 31813 raft_consensus.cc:3055] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:12.899657 31868 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:12.883850 31740 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.903154 30489 raft_consensus.cc:1275] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:57:12.893123 30429 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:12.893203 31931 raft_consensus.cc:740] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:12.846994 31938 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:12.886349 31839 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:12.885960 31944 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:12.822402 31939 raft_consensus.cc:2764] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260807 07:57:12.821835 31847 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.887128 31907 raft_consensus.cc:2804] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:12.924307 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:13.109220 31907 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:13.109681 31907 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:13.110081 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.925650 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:13.110894 30372 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:13.115157 30372 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:12.927444 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.928202 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:13.115929 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.116261 30365 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:12.931582 30317 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:13.117226 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 185717us
W20260807 07:57:12.961724 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 70358.7us
I20260807 07:57:12.903987 31766 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:12.933884 31944 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:12.975508 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:12.976284 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:13.123672 30369 raft_consensus.cc:2368] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4.
I20260807 07:57:13.124431 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:12.976864 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.127295 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:57:13.127925 30429 connection.cc:256] RPC call timeout handler was delayed by -2.41194309014827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
W20260807 07:57:13.128286 30429 connection.cc:256] RPC call timeout handler was delayed by -2.4056430901400745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
W20260807 07:57:13.128577 30429 connection.cc:256] RPC call timeout handler was delayed by -2.3903430902864784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
I20260807 07:57:13.128628 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:57:13.128904 30429 connection.cc:256] RPC call timeout handler was delayed by -2.25444309017621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260807 07:57:13.129208 30429 connection.cc:256] RPC call timeout handler was delayed by -2.2184430900961161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
I20260807 07:57:12.903173 31948 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:13.140923 31948 raft_consensus.cc:697] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:13.141896 31948 consensus_queue.cc:237] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.143133 31944 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.933885 31938 raft_consensus.cc:697] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:12.993855 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:12.921726 31927 raft_consensus.cc:2804] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:12.973974 31931 consensus_queue.cc:260] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:13.146003 31927 raft_consensus.cc:697] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:12.891791 31913 raft_consensus.cc:2804] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:12.890413 31799 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:13.086658 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 338391us
I20260807 07:57:13.146829 31927 consensus_queue.cc:237] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:12.905288 31813 raft_consensus.cc:740] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:12.901129 31868 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260807 07:57:12.893014 31871 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:13.091919 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:13.092481 31950 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4: Append to log took a long time: real 0.224s user 0.003s sys 0.009s
I20260807 07:57:13.092657 31839 raft_consensus.cc:697] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:13.094138 31951 log.cc:927] Time spent T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.210s user 0.010s sys 0.000s
W20260807 07:57:13.089221 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 113879us
W20260807 07:57:13.165565 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:13.095057 31849 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.106318 31383 raft_consensus.cc:1240] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:13.088460 31960 consensus_queue.cc:1059] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260807 07:57:13.106626 31966 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:13.106761 31795 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.107280 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:13.170876 30366 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:13.088559 31912 consensus_queue.cc:1048] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260807 07:57:13.088958 31933 raft_consensus.cc:3060] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:13.119629 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:13.174918 30367 raft_consensus.cc:2393] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:13.120379 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.121855 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:13.129608 30429 connection.cc:256] RPC call timeout handler was delayed by -2.0438430900685489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
I20260807 07:57:13.129726 30365 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
W20260807 07:57:13.175709 30429 connection.cc:256] RPC call timeout handler was delayed by -1.1654430902563035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3138s for a response
I20260807 07:57:13.176322 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.130625 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:13.176889 30365 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:13.131739 31932 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:13.131939 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.178537 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:13.179709 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:13.132092 31930 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:13.133194 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:13.133910 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:13.134542 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:13.135201 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:13.144946 31938 consensus_queue.cc:237] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.181857 30358 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:13.136773 31939 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:13.177050 31813 consensus_queue.cc:260] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.190100 31939 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.190506 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.191397 30358 raft_consensus.cc:2393] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:13.171718 31960 consensus_queue.cc:1243] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [LEADER]: Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260807 07:57:13.192209 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.137732 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:13.120287 31715 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:13.138760 31964 consensus_queue.cc:1048] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:13.129235 31903 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260807 07:57:13.139969 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:13.137178 30479 raft_consensus.cc:1275] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:13.150568 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:13.157397 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:13.164251 31944 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:13.170781 31913 raft_consensus.cc:697] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:57:13.087905 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.106069 31963 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:13.181223 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.180636 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.182099 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.251379 30365 raft_consensus.cc:2393] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:13.136268 30480 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:13.182957 30478 raft_consensus.cc:2393] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:13.182925 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.183422 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:13.171948 31966 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.253479 31338 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:13.186550 31849 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:13.107311 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:13.192318 31939 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:13.195662 31795 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:13.192346 31839 consensus_queue.cc:237] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.196084 31932 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.137877 30490 raft_consensus.cc:1240] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:13.244554 31715 raft_consensus.cc:697] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:13.161275 31846 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.211455 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:57:13.212854 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 64712.5us
W20260807 07:57:13.245915 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 69340.5us
W20260807 07:57:13.244920 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:13.246670 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:13.262118 31813 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:13.252393 30364 raft_consensus.cc:2393] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:13.243891 31868 raft_consensus.cc:3055] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:13.252416 30489 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:13.255427 30367 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:13.254699 31966 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:13.270226 31912 raft_consensus.cc:2764] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260807 07:57:13.292464 31846 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:13.219408 31412 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd680 after lost signal to thread 27911
I20260807 07:57:13.215374 30584 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:13.198354 30482 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:13.197299 31930 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.249814 30366 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:13.275593 30479 raft_consensus.cc:1275] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 07:57:13.276022 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:13.277069 30541 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:13.254393 31963 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.282519 31932 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:13.283053 30429 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:13.277421 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 60201.9us
I20260807 07:57:13.285831 31913 consensus_queue.cc:237] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:13.304381 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:13.278837 31868 raft_consensus.cc:740] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:13.307124 30429 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:57:13.255029 31847 consensus_queue.cc:1059] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260807 07:57:13.312068 30477 raft_consensus.cc:1240] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:13.313159 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:13.311537 30479 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:13.316460 30479 raft_consensus.cc:1240] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:13.317349 30489 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:13.325416 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:13.326339 30590 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 4
I20260807 07:57:13.282521 31928 consensus_queue.cc:1048] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260807 07:57:13.336504 30590 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 4.
I20260807 07:57:13.305411 31953 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:13.318549 30541 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:13.339298 30317 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:13.314986 31923 raft_consensus.cc:2804] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
W20260807 07:57:13.329581 31412 debug-util.cc:398] Leaking SignalData structure 0x7b08002fdd60 after lost signal to thread 30272
I20260807 07:57:13.324421 31981 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:13.344241 30541 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:13.341516 30317 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:13.328737 31975 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:13.329052 30363 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:13.345173 31906 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:13.364434 31383 raft_consensus.cc:1240] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260807 07:57:13.364876 31973 log.cc:927] Time spent T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
I20260807 07:57:13.381649 30541 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:13.365309 31412 debug-util.cc:398] Leaking SignalData structure 0x7b0800341000 after lost signal to thread 30405
I20260807 07:57:13.345264 31715 consensus_queue.cc:237] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.346747 31933 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:13.337898 31966 consensus_queue.cc:1048] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260807 07:57:13.349640 31868 consensus_queue.cc:260] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:13.343189 31953 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.395360 30363 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:13.340139 31849 consensus_queue.cc:1059] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260807 07:57:13.385241 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 70978.2us
I20260807 07:57:13.400851 31931 raft_consensus.cc:3060] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:13.354696 31684 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:13.353356 31740 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:13.349995 31923 raft_consensus.cc:697] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:13.386070 30541 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:13.342967 31871 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.368852 31981 raft_consensus.cc:697] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:13.382794 31975 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:13.393508 31868 raft_consensus.cc:3060] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:13.346951 31937 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 07:57:13.354032 31841 raft_consensus.cc:2955] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:13.413570 31933 raft_consensus.cc:1064] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
W20260807 07:57:13.413998 31933 raft_consensus.cc:1068] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: Unable to promote non-voter 6bd20e9c0d3e4ace86fc1f55ab9425fa: Illegal state: Leader has not yet committed an operation in its own term
I20260807 07:57:13.414126 31871 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:13.368531 31906 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:13.383116 31962 consensus_queue.cc:1059] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260807 07:57:13.349037 31989 consensus_queue.cc:1048] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260807 07:57:13.415159 31981 consensus_queue.cc:237] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.414945 31906 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:13.386462 30364 raft_consensus.cc:1275] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 07:57:13.407334 30429 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:13.404826 30541 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:13.408500 31984 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:13.424285 31984 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:13.425490 31849 raft_consensus.cc:3055] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:13.425925 31849 raft_consensus.cc:740] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:13.426960 31740 raft_consensus.cc:697] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:13.427443 31975 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:13.428164 31740 consensus_queue.cc:237] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:13.428844 31412 debug-util.cc:398] Leaking SignalData structure 0x7b0800289b80 after lost signal to thread 30521
I20260807 07:57:13.402061 31684 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:13.437808 30541 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:13.439333 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:13.440876 30429 leader_election.cc:400] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4.
I20260807 07:57:13.441195 30429 leader_election.cc:403] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260807 07:57:13.442387 30489 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:13.443339 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:13.445446 30479 raft_consensus.cc:1240] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:13.448560 30479 raft_consensus.cc:1275] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:13.449529 30479 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:13.445446 30429 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:13.430326 31412 debug-util.cc:398] Leaking SignalData structure 0x7b0800321620 after lost signal to thread 30627
I20260807 07:57:13.455741 31984 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 07:57:13.396193 31846 consensus_queue.cc:1175] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ef1ca7acf52a438f89f14707e9e06818" responder_term: 4 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 07:57:13.457724 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:13.458302 30541 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:13.420379 31799 raft_consensus.cc:2749] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:13.459645 30429 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:13.463804 30541 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:13.465946 31412 debug-util.cc:398] Leaking SignalData structure 0x7b080033b4a0 after lost signal to thread 31418
I20260807 07:57:13.469584 31970 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:13.463115 31989 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260807 07:57:13.437753 31684 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:13.438175 31839 raft_consensus.cc:2804] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:13.437945 31930 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:13.443576 31939 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4.
I20260807 07:57:13.463323 31915 consensus_queue.cc:1048] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260807 07:57:13.472990 30429 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:13.482334 31903 consensus_queue.cc:1048] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:13.463852 31927 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:13.414919 31923 consensus_queue.cc:237] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.474771 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:13.481562 31970 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:13.427000 31849 consensus_queue.cc:260] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.472505 31933 consensus_queue.cc:1059] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260807 07:57:13.515745 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:13.515496 30541 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:13.473328 31907 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.523557 31927 raft_consensus.cc:697] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:13.525043 31930 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:13.525013 31927 consensus_queue.cc:237] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.525979 31930 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:13.526615 31930 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:13.533066 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 60125.2us
I20260807 07:57:13.534617 30429 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:13.536656 31938 raft_consensus.cc:2804] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:13.537073 31942 raft_consensus.cc:2804] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:13.537309 31938 raft_consensus.cc:697] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:13.487968 31964 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260807 07:57:13.513636 30477 raft_consensus.cc:1240] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 07:57:13.537787 31942 raft_consensus.cc:697] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:13.544116 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:13.506662 31839 raft_consensus.cc:697] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:13.513283 31953 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:13.542856 30429 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:13.559361 31942 consensus_queue.cc:237] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.565518 31849 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:13.566473 31907 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:13.551813 30487 raft_consensus.cc:2393] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:13.576318 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.577190 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.587546 30364 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:13.587637 30366 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:13.628340 31839 consensus_queue.cc:237] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:13.644989 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:13.594414 31948 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:13.593477 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:13.649036 30590 raft_consensus.cc:1275] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260807 07:57:13.649883 30590 pending_rounds.cc:85] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e: Aborting all ops after (but not including) 4
I20260807 07:57:13.650147 30590 pending_rounds.cc:107] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260807 07:57:13.650401 30590 raft_consensus.cc:2889] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:13.651909 32003 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:13.652597 32003 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:13.663625 32003 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:13.623884 31383 raft_consensus.cc:1240] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
W20260807 07:57:13.673810 30319 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:13.583290 31938 consensus_queue.cc:237] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.649659 31813 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:13.666066 31948 raft_consensus.cc:697] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:13.681469 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:13.639343 31907 consensus_queue.cc:1059] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260807 07:57:13.703490 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:13.673285 31963 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:13.710700 30221 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53660 (request call id 183) took 1545 ms. Trace:
I20260807 07:57:13.709692 31871 raft_consensus.cc:3055] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:13.722708 31871 raft_consensus.cc:740] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:13.709765 31383 raft_consensus.cc:2393] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:57:13.727988 30223 catalog_manager.cc:5697] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 3 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 4 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:57:13.729734 30223 catalog_manager.cc:5697] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 3 to 4, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 4 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:57:13.710866 31846 raft_consensus.cc:3055] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:13.707020 31966 consensus_queue.cc:1059] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260807 07:57:13.698553 31813 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:13.687150 31948 consensus_queue.cc:237] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.736006 31871 consensus_queue.cc:260] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.739787 30220 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53656 (request call id 201) took 1021 ms. Trace:
I20260807 07:57:13.698915 31906 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.747215 31684 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.747397 31930 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.688038 31915 consensus_queue.cc:1048] T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260807 07:57:13.749536 30220 rpcz_store.cc:276] 0807 07:57:12.718258 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:12.718506 (+ 248us) service_pool.cc:224] Handling call
0807 07:57:12.805248 (+ 86742us) spinlock_profiling.cc:243] Waited 53.8 ms on lock 0x7b54002a1a54. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b5260470 00007fd6b52ff31a 00007fd6bb0ef38c 00007fd6bb1ebbfe 00007fd6b96a54a4 00007fd6b96a5432 00007fd6b96a5361 00007fd6b96a52dc 00007fd6b96a4592 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:12.814489 (+ 9241us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b5800032020. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8ff0 00007fd6bb0e3d36 00007fd6bb1ec4be 00007fd6b96a54a4 00007fd6b96a5432 00007fd6b96a5361 00007fd6b96a52dc 00007fd6b96a4592 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:13.739722 (+925233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161696,"reported_tablets":3,"spinlock_wait_cycles":139228288}
I20260807 07:57:13.751906 31813 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:13.720942 30221 rpcz_store.cc:276] 0807 07:57:12.165046 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:12.165211 (+ 165us) service_pool.cc:224] Handling call
0807 07:57:13.710613 (+1545402us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:12.513203 (+ 0us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b540011f728. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb6ecc21 00007fd6bb6eb88c 00007fd6b8d604bc 00007fd6b8d4ba86 00007fd6b8d4b738 00007fd6b8d503d1 00007fd6b8d50389 00007fd6b8d50319 00007fd6b8d502e1 00007fd6b8d4f50d 00000000003aa554
0807 07:57:12.513293 (+ 90us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:12.533647 (+ 20354us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:12.535568 (+ 1921us) write_op.cc:435] Acquired schema lock
0807 07:57:12.535587 (+ 19us) tablet.cc:662] Decoding operations
0807 07:57:12.536336 (+ 749us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:12.536391 (+ 55us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:12.536416 (+ 25us) tablet.cc:685] Acquiring locks for 6 operations
0807 07:57:12.633604 (+ 97188us) tablet.cc:701] Row locks acquired
0807 07:57:12.633624 (+ 20us) write_op.cc:260] PREPARE: finished
0807 07:57:12.633753 (+ 129us) write_op.cc:270] Start()
0807 07:57:12.633944 (+ 191us) write_op.cc:276] Timestamp: P: 1786089432633714 usec, L: 0
0807 07:57:12.633963 (+ 19us) op_driver.cc:348] REPLICATION: starting
0807 07:57:12.634608 (+ 645us) log.cc:844] Serialized 2534 byte log entry
0807 07:57:13.352832 (+718224us) op_driver.cc:464] REPLICATION: finished
0807 07:57:13.465401 (+112569us) write_op.cc:301] APPLY: starting
0807 07:57:13.465514 (+ 113us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:13.465717 (+ 203us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:13.465745 (+ 28us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:13.466645 (+ 900us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:13.466879 (+ 234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0807 07:57:13.466965 (+ 86us) write_op.cc:312] APPLY: finished
0807 07:57:13.467328 (+ 363us) log.cc:844] Serialized 52 byte log entry
0807 07:57:13.467515 (+ 187us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:13.467636 (+ 121us) write_op.cc:454] Released schema lock
0807 07:57:13.467678 (+ 42us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:13.468096 (+ 418us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:13.468133 (+ 37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17950,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":110139,"apply.run_cpu_time_us":2670,"apply.run_wall_time_us":2670,"num_ops":6,"prepare.queue_time_us":47958,"prepare.run_cpu_time_us":16346,"prepare.run_wall_time_us":348655,"raft.queue_time_us":141071,"raft.run_cpu_time_us":8496,"raft.run_wall_time_us":56004,"replication_time_us":713937,"spinlock_wait_cycles":8720768,"thread_start_us":244642,"threads_started":4,"wal-append.queue_time_us":161866}]]}
I20260807 07:57:13.741331 31846 raft_consensus.cc:740] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:13.755658 31684 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:13.767912 31871 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:13.778456 31930 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:13.785034 30476 raft_consensus.cc:2468] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 4.
W20260807 07:57:13.786867 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:13.790445 30480 raft_consensus.cc:1275] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 07:57:13.791234 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:13.792459 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:13.817978 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:13.815500 30476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34358 (request call id 24) took 1322 ms (client timeout 1672 ms). Trace:
I20260807 07:57:13.785323 31846 consensus_queue.cc:260] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:13.835223 31906 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:13.838617 31932 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 07:57:13.826038 30476 rpcz_store.cc:269] 0807 07:57:12.482251 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:12.513854 (+ 31603us) service_pool.cc:224] Handling call
0807 07:57:13.107160 (+593306us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b5800091898. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b83d2 00007fd6bb124219 00007fd6ba277640 00007fd6ba33febb 00007fd6ba33ff41 00007fd6ba2edeb0 00007fd6ba2ed794 00007fd6b3836834 00007fd6b38367c2
0807 07:57:13.789678 (+682518us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b540025b554. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:13.804208 (+ 14530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965205504}
W20260807 07:57:13.854594 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:13.840210 31846 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:13.834568 31913 consensus_queue.cc:1048] T 30057a01f5fa4baba4b3b02fe84a0f78 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260807 07:57:13.849514 31932 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:13.874569 31932 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:13.896090 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:13.918346 30360 raft_consensus.cc:1275] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:57:13.951450 30366 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:13.960592 30366 raft_consensus.cc:1275] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:13.960714 30372 raft_consensus.cc:1275] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:13.966444 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:13.935228 31915 consensus_queue.cc:1048] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260807 07:57:13.981494 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:13.984207 30372 raft_consensus.cc:2393] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
W20260807 07:57:13.985179 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 449298us
W20260807 07:57:13.988059 30490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s user 0.007s sys 0.022s
W20260807 07:57:13.988472 30490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s user 0.007s sys 0.023s
I20260807 07:57:13.989727 31915 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:13.990289 31915 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:13.997673 31915 leader_election.cc:290] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:14.001998 30541 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:14.005184 30541 leader_election.cc:400] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:14.006321 30541 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:14.009558 31907 raft_consensus.cc:2804] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 07:57:13.999965 31740 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s user 0.018s sys 0.010s
I20260807 07:57:14.019884 30541 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:14.021584 30541 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:14.017874 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 436642us
I20260807 07:57:14.009927 31907 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:14.038617 31964 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:14.039072 30541 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:14.041976 31960 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260807 07:57:14.017249 31740 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s user 0.019s sys 0.010s
I20260807 07:57:14.016556 31871 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260807 07:57:14.088474 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 111194us
I20260807 07:57:14.024348 31684 raft_consensus.cc:2749] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:14.090059 30429 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:14.088707 30478 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s user 0.012s sys 0.030s
I20260807 07:57:14.091012 30541 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:14.102414 30478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s user 0.012s sys 0.030s
I20260807 07:57:14.104038 30429 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:14.088311 31715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s user 0.005s sys 0.033s
W20260807 07:57:14.119871 30488 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s user 0.002s sys 0.014s
I20260807 07:57:14.044338 31907 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:14.089321 31871 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:14.143158 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:14.127049 30319 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:14.120610 30541 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:14.120378 30488 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.537s user 0.003s sys 0.014s
W20260807 07:57:14.102849 31795 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s user 0.008s sys 0.008s
I20260807 07:57:14.103893 31813 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:14.117923 31715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s user 0.005s sys 0.033s
I20260807 07:57:14.171797 32025 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 07:57:14.196053 31980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s user 0.007s sys 0.007s
I20260807 07:57:14.126497 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:14.327790 30223 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.579s user 0.005s sys 0.020s
W20260807 07:57:14.334342 30223 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s user 0.005s sys 0.020s
W20260807 07:57:14.209484 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:14.337926 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 211020us
W20260807 07:57:14.338413 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:14.344396 30482 raft_consensus.cc:1240] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:14.236089 30578 raft_consensus.cc:1275] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:57:14.251070 31382 raft_consensus.cc:1240] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:14.197944 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:14.206707 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 86169.3us
I20260807 07:57:14.352159 30584 raft_consensus.cc:2468] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 2.
I20260807 07:57:14.354476 30476 raft_consensus.cc:1240] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:14.363972 31338 leader_election.cc:304] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:14.126108 31684 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:14.476994 32015 log.cc:927] Time spent T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.197s user 0.000s sys 0.001s
I20260807 07:57:14.368016 31715 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:57:14.482335 32017 log.cc:927] Time spent T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.205s user 0.000s sys 0.000s
I20260807 07:57:14.482010 31715 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:14.486097 30490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33916 (request call id 761) took 1048 ms. Trace:
I20260807 07:57:14.126925 31740 raft_consensus.cc:3055] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
W20260807 07:57:14.186841 31795 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s user 0.010s sys 0.008s
I20260807 07:57:14.203490 31813 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:14.540506 30360 raft_consensus.cc:2468] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 1.
I20260807 07:57:14.372305 30489 raft_consensus.cc:1240] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:14.543344 30489 raft_consensus.cc:1275] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260807 07:57:14.356689 30480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s user 0.006s sys 0.026s
I20260807 07:57:14.375469 30372 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:14.178342 31871 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:14.355777 30477 raft_consensus.cc:1240] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 07:57:14.121240 31931 raft_consensus.cc:2804] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:14.563941 31931 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:14.564427 31931 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:14.568271 31907 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:14.166631 31923 consensus_queue.cc:1048] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260807 07:57:14.237519 31937 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:14.236637 31932 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:14.196610 31942 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s user 0.007s sys 0.011s
W20260807 07:57:14.588925 31942 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.950s user 0.007s sys 0.011s
I20260807 07:57:14.121598 31939 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
W20260807 07:57:14.211767 31980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s user 0.008s sys 0.008s
I20260807 07:57:14.117993 31981 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:14.201889 32000 consensus_queue.cc:1048] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260807 07:57:14.593237 31981 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:14.594458 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:14.594671 32013 log.cc:927] Time spent T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.394s user 0.001s sys 0.001s
W20260807 07:57:14.230720 32018 log.cc:927] Time spent T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.169s user 0.001s sys 0.001s
I20260807 07:57:14.360919 30541 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:14.422421 32026 log.cc:927] Time spent T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.139s user 0.000s sys 0.001s
W20260807 07:57:14.426436 32009 log.cc:927] Time spent T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.322s user 0.000s sys 0.001s
W20260807 07:57:14.597941 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 237382us
W20260807 07:57:14.433563 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:14.598871 32019 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:14.436939 32025 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:14.436484 31915 consensus_queue.cc:1048] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:14.475124 31849 consensus_queue.cc:1059] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:14.487785 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33916 (request call id 763) took 1047 ms. Trace:
I20260807 07:57:14.601982 30478 rpcz_store.cc:276] 0807 07:57:13.440317 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:13.440437 (+ 120us) service_pool.cc:224] Handling call
0807 07:57:13.440729 (+ 292us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:13.440953 (+ 224us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:13.440980 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:13.462311 (+ 21331us) log.cc:844] Serialized 26 byte log entry
0807 07:57:14.102835 (+640524us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:14.102879 (+ 44us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:14.103204 (+ 325us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:14.487344 (+384140us) raft_consensus.cc:1685] finished
0807 07:57:14.487382 (+ 38us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:14.487611 (+ 229us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":613219,"threads_started":1,"wal-append.queue_time_us":787280}
I20260807 07:57:14.604583 30478 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 07:57:14.491108 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 73745.7us
I20260807 07:57:14.506035 31684 raft_consensus.cc:2749] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:14.506677 30366 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:14.486554 30490 rpcz_store.cc:276] 0807 07:57:13.437633 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:13.437746 (+ 113us) service_pool.cc:224] Handling call
0807 07:57:13.438068 (+ 322us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:13.438396 (+ 328us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:13.438424 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:13.461089 (+ 22665us) log.cc:844] Serialized 26 byte log entry
0807 07:57:13.988894 (+527805us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:13.988935 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:13.989000 (+ 65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:14.485616 (+496616us) raft_consensus.cc:1685] finished
0807 07:57:14.485673 (+ 57us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:14.485923 (+ 250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":444,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":17335,"thread_start_us":503180,"threads_started":1,"wal-append.queue_time_us":802700}
I20260807 07:57:14.509872 31715 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:14.606388 31871 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:14.534344 31740 raft_consensus.cc:740] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:14.534883 30358 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:14.608214 31740 consensus_queue.cc:260] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:14.541076 31813 leader_election.cc:290] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:57:14.562634 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 199516us
W20260807 07:57:14.546895 30480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s user 0.007s sys 0.026s
W20260807 07:57:14.587868 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 126409us
W20260807 07:57:14.587488 31846 consensus_meta.cc:287] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.715s user 0.007s sys 0.013s
I20260807 07:57:14.231038 32012 raft_consensus.cc:2749] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:14.533737 31964 raft_consensus.cc:2749] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:14.590764 31912 raft_consensus.cc:2804] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:14.600273 32025 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:14.608826 31937 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:14.653045 32055 log.cc:927] Time spent T 0032603adf8446cd9a59f26cc868400c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
I20260807 07:57:14.653317 32067 consensus_queue.cc:1059] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:14.614578 31912 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:14.653700 31937 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:14.657230 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:14.657076 31813 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:14.725256 30360 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 07:57:14.717434 32072 log.cc:927] Time spent T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.100s user 0.000s sys 0.001s
W20260807 07:57:14.734046 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:14.720512 32063 log.cc:927] Time spent T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.181s user 0.001s sys 0.003s
I20260807 07:57:14.601234 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:14.739980 31385 raft_consensus.cc:2468] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:14.742596 30542 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:14.744835 30358 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:14.746076 30363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33338 (request call id 23) took 1229 ms. Trace:
I20260807 07:57:14.746495 30363 rpcz_store.cc:276] 0807 07:57:13.516970 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:13.518470 (+ 1500us) service_pool.cc:224] Handling call
0807 07:57:13.552784 (+ 34314us) raft_consensus.cc:1471] Updating replica for 2 ops
0807 07:57:13.553305 (+ 521us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:13.553368 (+ 63us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0807 07:57:13.554332 (+ 964us) log.cc:844] Serialized 52 byte log entry
0807 07:57:13.958373 (+404041us) raft_consensus.cc:1645] Marking committed up to 4
0807 07:57:13.958419 (+ 46us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:13.958490 (+ 71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:14.736476 (+777986us) raft_consensus.cc:1685] finished
0807 07:57:14.738869 (+ 2393us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:14.745872 (+ 7003us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2995,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":8153,"thread_start_us":395269,"threads_started":1,"wal-append.queue_time_us":488451}
I20260807 07:57:14.748865 31915 consensus_queue.cc:1048] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:14.730309 31912 raft_consensus.cc:3060] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:14.731115 31740 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:14.658069 31715 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:14.738752 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33916 (request call id 782) took 1097 ms. Trace:
I20260807 07:57:14.762874 30372 raft_consensus.cc:1275] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:14.753366 32067 raft_consensus.cc:2804] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:14.766911 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33916 (request call id 775) took 1300 ms. Trace:
I20260807 07:57:14.767395 30479 rpcz_store.cc:276] 0807 07:57:13.454509 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:13.461040 (+ 6531us) service_pool.cc:224] Handling call
0807 07:57:13.461319 (+ 279us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:13.461780 (+ 461us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:13.461808 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:13.462226 (+ 418us) log.cc:844] Serialized 26 byte log entry
0807 07:57:13.837012 (+374786us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:13.837049 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:13.837120 (+ 71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:14.736540 (+899420us) raft_consensus.cc:1685] finished
0807 07:57:14.738933 (+ 2393us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:14.754593 (+ 15660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20678,"raft.queue_time_us":9199,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":13899,"thread_start_us":342959,"threads_started":1,"wal-append.queue_time_us":521442}
I20260807 07:57:14.768419 31942 consensus_queue.cc:1048] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:14.769918 32071 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:14.770478 32071 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:14.772892 32071 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:14.767551 30541 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:14.791685 32003 consensus_queue.cc:1059] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260807 07:57:14.794659 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 206922us
I20260807 07:57:14.773891 32067 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:14.802179 30479 raft_consensus.cc:1275] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 07:57:14.803228 30320 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 2.581s (SENT) [suppressed 35 similar messages]
W20260807 07:57:14.806877 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 84680.1us
I20260807 07:57:14.808039 31871 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:14.800763 32067 raft_consensus.cc:3060] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:14.810640 32075 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:14.811203 32075 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:14.814388 31964 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:14.815439 31931 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:14.763269 31813 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:14.798189 31907 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:14.821432 31932 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:14.805636 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 55843.5us
W20260807 07:57:14.825630 30319 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:14.826808 31960 raft_consensus.cc:3055] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:14.827245 31960 raft_consensus.cc:740] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:14.812877 32025 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:14.819278 31715 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:14.831893 31715 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:14.833534 32065 log.cc:927] Time spent T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.242s user 0.002s sys 0.000s
I20260807 07:57:14.833966 31684 raft_consensus.cc:1064] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:14.834914 30487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33916 (request call id 777) took 1334 ms. Trace:
I20260807 07:57:14.835306 30487 rpcz_store.cc:276] 0807 07:57:13.500772 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:13.620156 (+119384us) service_pool.cc:224] Handling call
0807 07:57:13.620636 (+ 480us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:14.101474 (+480838us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:14.104825 (+ 3351us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:14.337532 (+232707us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b2c0005b888. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b3bf1c71 00007fd6b3c015d2 00007fd6b5331de1 00007fd6b52f681a 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22
0807 07:57:14.338670 (+ 1138us) log.cc:844] Serialized 26 byte log entry
0807 07:57:14.530240 (+191570us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:14.531225 (+ 985us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:14.545089 (+ 13864us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:14.832766 (+287677us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b440002250c. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b2116855 00007fd6b2117272 00007fd6b4ea13bb 00007fd6b4e9cc9f 00007fd6b4e90a5e 00007fd6b4e8fda6 00007fd6b4e8f9c8 00007fd6b4e99411 00007fd6b4e993c9 00007fd6b4e99359
0807 07:57:14.834542 (+ 1776us) raft_consensus.cc:1685] finished
0807 07:57:14.834564 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:14.834728 (+ 164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8007,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":37362688,"thread_start_us":657939,"threads_started":2,"wal-append.queue_time_us":251731}
I20260807 07:57:14.841799 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:14.841591 31684 consensus_queue.cc:237] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:14.845793 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 78386.5us
W20260807 07:57:14.837182 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 299709us
I20260807 07:57:14.852365 31849 raft_consensus.cc:3055] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:14.852802 31849 raft_consensus.cc:740] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:14.853358 32061 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:14.854043 32061 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:14.853824 31849 consensus_queue.cc:260] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:14.855715 31849 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:14.856362 31932 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:14.828243 32003 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260807 07:57:14.857025 31932 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:14.867130 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 43599.9us
I20260807 07:57:14.873562 31931 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:14.875098 31960 consensus_queue.cc:260] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:14.765336 30480 rpcz_store.cc:276] 0807 07:57:13.640061 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:13.820227 (+180166us) service_pool.cc:224] Handling call
0807 07:57:13.830426 (+ 10199us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:13.830875 (+ 449us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:13.830914 (+ 39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:13.831437 (+ 523us) log.cc:844] Serialized 26 byte log entry
0807 07:57:14.610915 (+779478us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:14.611008 (+ 93us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:14.611094 (+ 86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:14.611150 (+ 56us) raft_consensus.cc:1685] finished
0807 07:57:14.611166 (+ 16us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:14.737701 (+126535us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1155,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":2109,"thread_start_us":778820,"threads_started":1,"wal-append.queue_time_us":450616}
I20260807 07:57:14.873948 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:14.865012 32071 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:14.881347 31960 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:14.900354 32061 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:14.884362 30477 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 2.
I20260807 07:57:14.890205 31871 consensus_queue.cc:1048] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260807 07:57:14.903805 31932 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:14.890497 31846 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260807 07:57:14.908521 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:14.909639 31906 consensus_queue.cc:1048] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 07:57:14.894577 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:14.910233 31966 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:14.917613 30488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34358 (request call id 29) took 1110 ms. Trace:
I20260807 07:57:14.917436 31966 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:14.892813 31383 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 07:57:14.919780 31966 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:14.895095 31813 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:14.921216 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:14.922051 30363 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:14.885344 32071 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:14.892935 32025 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:14.923151 31385 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
W20260807 07:57:14.925545 32073 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4: Append to log took a long time: real 0.122s user 0.000s sys 0.001s
I20260807 07:57:14.922740 31981 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:14.909438 32067 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:14.930015 32070 log.cc:927] Time spent T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.128s user 0.000s sys 0.000s
I20260807 07:57:14.922428 32075 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:14.932075 30363 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:14.933336 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:14.946477 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34358 (request call id 30) took 1021 ms. Trace:
I20260807 07:57:14.934592 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:14.936440 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:14.947670 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:14.947822 30358 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:14.948313 30480 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:14.937325 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:14.937485 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:14.949112 30366 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:14.938306 32061 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:14.949561 31871 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:14.950485 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:14.939313 31931 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 07:57:14.948072 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:14.952008 31383 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:14.944376 30320 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:14.944741 31948 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:14.936722 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:14.956434 30367 raft_consensus.cc:2393] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:14.941982 32025 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:14.957352 31912 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:14.959595 31912 leader_election.cc:290] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:14.940707 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:14.978886 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:14.960618 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:14.979530 30364 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:14.981678 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:14.982800 31715 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:14.985927 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:14.918125 30488 rpcz_store.cc:276] 0807 07:57:13.679707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:14.229940 (+550233us) service_pool.cc:224] Handling call
0807 07:57:14.230276 (+ 336us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:14.245817 (+ 15541us) raft_consensus.cc:1534] Early marking committed up to index 5
0807 07:57:14.521596 (+275779us) log.cc:844] Serialized 14 byte log entry
0807 07:57:14.754896 (+233300us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:14.757886 (+ 2990us) raft_consensus.cc:1645] Marking committed up to 5
0807 07:57:14.764246 (+ 6360us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:14.774844 (+ 10598us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:14.790421 (+ 15577us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":220042,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":649,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5050,"thread_start_us":344337,"threads_started":2,"wal-append.queue_time_us":248795}
I20260807 07:57:14.987596 30478 raft_consensus.cc:1240] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:14.981570 31382 raft_consensus.cc:2368] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:14.986565 30369 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:14.995507 31932 consensus_queue.cc:1048] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:14.946872 30476 rpcz_store.cc:276] 0807 07:57:13.924671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:14.377795 (+453124us) service_pool.cc:224] Handling call
0807 07:57:14.378464 (+ 669us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:14.379291 (+ 827us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:14.379324 (+ 33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:14.380031 (+ 707us) log.cc:844] Serialized 26 byte log entry
0807 07:57:14.733103 (+353072us) raft_consensus.cc:1645] Marking committed up to 4
0807 07:57:14.734787 (+ 1684us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:14.738913 (+ 4126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:14.946278 (+207365us) raft_consensus.cc:1685] finished
0807 07:57:14.946306 (+ 28us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:14.946421 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20458,"raft.queue_time_us":89315,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":172,"thread_start_us":172787,"threads_started":1,"wal-append.queue_time_us":369930}
I20260807 07:57:14.997045 30480 raft_consensus.cc:1240] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:14.997370 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:14.995958 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:14.951192 30477 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:15.009003 30369 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:15.021806 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:15.022478 30367 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:14.991868 32061 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260807 07:57:15.036914 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:15.037488 30364 raft_consensus.cc:2468] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 1.
I20260807 07:57:15.037626 30369 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:15.049440 30482 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 07:57:15.050465 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:15.064015 30317 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:15.033850 31964 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:15.090525 30367 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:15.092082 30369 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:15.102296 30372 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:15.091914 31966 raft_consensus.cc:2804] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:15.106931 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:15.109882 30369 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 2.
I20260807 07:57:15.113801 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.114871 30584 raft_consensus.cc:2393] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
W20260807 07:57:15.117486 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:15.119808 31338 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
I20260807 07:57:15.124405 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:15.125154 30358 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:15.108631 31966 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:15.160326 30429 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:15.103891 31964 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:15.175504 30429 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:15.194236 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 106733us
I20260807 07:57:15.195068 30317 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:15.165536 31966 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:15.168366 31907 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260807 07:57:15.202901 30429 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:15.175956 32067 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:15.210384 32085 raft_consensus.cc:2804] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:15.177935 31948 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:15.211396 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:15.210865 32085 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:15.215680 30429 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:15.215045 30482 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 2.
I20260807 07:57:15.172700 31937 consensus_queue.cc:1059] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
W20260807 07:57:15.221273 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 111973us
I20260807 07:57:15.205432 32061 raft_consensus.cc:2804] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:15.204030 31715 raft_consensus.cc:2804] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:15.235484 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:15.236630 30369 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 2.
I20260807 07:57:15.241300 30429 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:15.218165 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.218508 32025 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
W20260807 07:57:15.296299 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 55110.8us
I20260807 07:57:15.222891 32085 raft_consensus.cc:3060] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:15.304613 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 59578us
I20260807 07:57:15.243036 31715 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:15.213724 32071 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:15.310278 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:15.311007 30369 raft_consensus.cc:3060] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:15.243978 31948 raft_consensus.cc:697] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:15.316489 32039 log.cc:927] Time spent T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.182s user 0.001s sys 0.000s
I20260807 07:57:15.320729 31927 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:15.321516 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:15.330848 30584 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 2.
I20260807 07:57:15.333276 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:15.304359 32061 raft_consensus.cc:697] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:15.312428 31871 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:15.309007 31715 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:15.325964 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 62258.4us
I20260807 07:57:15.306746 31932 raft_consensus.cc:2804] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:15.245112 31338 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:15.310376 32025 raft_consensus.cc:697] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:15.377851 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 44351.6us
I20260807 07:57:15.378813 31932 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 07:57:15.400789 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 181917us
I20260807 07:57:15.401198 31932 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:15.313712 31980 consensus_queue.cc:1059] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.203s
I20260807 07:57:15.337939 31927 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:15.414321 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 55662.1us
I20260807 07:57:15.414948 30369 raft_consensus.cc:2468] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 3.
W20260807 07:57:15.391522 32103 log.cc:927] Time spent T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.175s user 0.000s sys 0.001s
I20260807 07:57:15.426838 30369 raft_consensus.cc:1240] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:15.426671 31948 consensus_queue.cc:237] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:15.414572 32075 raft_consensus.cc:2804] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:15.417635 31927 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:15.358280 30578 raft_consensus.cc:3060] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:15.417608 31907 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:15.435310 32075 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:15.435740 30430 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:15.457522 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:15.462219 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 114288us
I20260807 07:57:15.376451 31937 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:15.420383 31871 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:15.458953 32075 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:15.465152 31964 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:15.510612 32117 log.cc:927] Time spent T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.103s user 0.000s sys 0.001s
I20260807 07:57:15.472399 31980 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:15.459004 31338 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:15.525259 32104 log.cc:927] Time spent T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.213s user 0.000s sys 0.001s
I20260807 07:57:15.495376 32061 consensus_queue.cc:237] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:15.530023 31923 raft_consensus.cc:2804] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:15.498800 31937 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:15.519496 31960 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:15.533948 31923 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:15.506315 32025 consensus_queue.cc:237] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:15.534852 31966 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:15.534592 31907 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:15.549974 31923 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:15.575703 32082 raft_consensus.cc:2804] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:15.576185 32082 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:15.576607 32082 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:15.577554 32018 log.cc:927] Time spent T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.232s user 0.000s sys 0.001s
I20260807 07:57:15.578510 30323 leader_election.cc:400] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619) with higher term. Message: Invalid argument: T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:15.578990 30323 leader_election.cc:403] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:57:15.535183 31980 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:15.583425 31871 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:15.585139 32116 log.cc:927] Time spent T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.154s user 0.003s sys 0.000s
W20260807 07:57:15.585487 32105 log.cc:927] Time spent T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.183s user 0.000s sys 0.001s
I20260807 07:57:15.591544 31966 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:15.594596 32123 log.cc:927] Time spent T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260807 07:57:15.572077 31960 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:15.596943 31932 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:15.597821 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:57:15.599916 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 51879.5us
I20260807 07:57:15.601781 32003 raft_consensus.cc:2749] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619) with higher term. Message: Invalid argument: T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:15.602231 32012 raft_consensus.cc:3055] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:15.642639 31907 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:15.646575 31927 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:15.651429 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:15.659893 31937 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:15.637372 32012 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:15.649194 31927 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:15.631623 30487 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:15.657147 31923 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:15.663586 32012 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:15.666376 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:15.667634 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:15.668893 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:15.668642 32085 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:15.669845 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:15.672465 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:15.672744 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.673367 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.673650 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:15.669565 30590 raft_consensus.cc:2955] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:15.678886 31932 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:15.679323 32082 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:15.680389 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:15.682477 30578 raft_consensus.cc:2468] T 1f5785da4aac4398afc22beefd2bd76b P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 3.
I20260807 07:57:15.688848 31980 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:15.715674 30581 raft_consensus.cc:2393] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:15.731702 30585 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:15.696141 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 262942us
I20260807 07:57:15.724963 30579 raft_consensus.cc:2368] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3.
I20260807 07:57:15.725843 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.726541 30588 raft_consensus.cc:2393] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:15.727420 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:15.743497 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.730928 32012 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:15.745847 30582 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
W20260807 07:57:15.720690 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 305647us
W20260807 07:57:15.752847 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 295351us
I20260807 07:57:15.754387 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.757915 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.758916 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.759595 32075 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:15.762246 31382 raft_consensus.cc:2393] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:57:15.762588 31383 raft_consensus.cc:2393] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:57:15.759675 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.769395 30588 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:15.771957 30585 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:15.772725 30587 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:15.776081 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:15.778592 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:15.779444 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:15.779808 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:15.783308 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.783852 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.784315 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:15.790395 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.790825 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.795011 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.795832 30587 raft_consensus.cc:2410] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:15.796689 30588 raft_consensus.cc:2410] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for term 4 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260807 07:57:15.797879 30582 raft_consensus.cc:1240] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:15.790027 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.803866 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:15.803097 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:15.809155 30477 raft_consensus.cc:1240] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:15.799331 32138 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:57:15.810087 32138 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:15.810811 32082 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:15.812434 30586 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:15.785199 31715 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:15.813930 31960 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:15.815538 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:15.817842 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.836992 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.837613 30590 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 1.
W20260807 07:57:15.841180 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:15.845491 31970 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:15.845737 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.846526 30588 raft_consensus.cc:2410] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:15.873888 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:15.874693 30490 raft_consensus.cc:2368] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
W20260807 07:57:15.884996 32144 log.cc:927] Time spent T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.069s user 0.000s sys 0.000s
I20260807 07:57:15.887217 30487 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:15.888789 30317 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:15.889653 31849 raft_consensus.cc:2804] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:15.890149 31849 raft_consensus.cc:697] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:15.891072 31849 consensus_queue.cc:237] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:15.894487 32138 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:57:15.846531 32142 log.cc:927] Time spent T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.074s user 0.001s sys 0.000s
I20260807 07:57:15.839661 32085 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:15.901561 32131 log.cc:927] Time spent T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260807 07:57:15.912716 30590 raft_consensus.cc:1240] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:15.879204 31970 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:15.840129 32129 consensus_queue.cc:1048] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260807 07:57:15.902558 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:15.901329 31715 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:15.923552 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:15.924916 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.925771 30579 raft_consensus.cc:2393] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:15.926549 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.929519 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:15.931670 30360 raft_consensus.cc:1275] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 07:57:15.932052 30360 pending_rounds.cc:85] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19: Aborting all ops after (but not including) 1
I20260807 07:57:15.932309 30360 pending_rounds.cc:107] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 07:57:15.932576 30360 raft_consensus.cc:2889] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:15.901645 31338 leader_election.cc:304] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
I20260807 07:57:15.933749 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:15.933984 30373 raft_consensus.cc:1240] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:15.934783 30363 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:15.935321 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:15.935745 31923 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:15.952378 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:15.953255 30477 raft_consensus.cc:2393] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:15.954802 32085 raft_consensus.cc:2804] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:15.955471 32085 raft_consensus.cc:697] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:57:15.956445 32085 consensus_queue.cc:237] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:15.928175 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:15.959077 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:15.959383 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:15.962402 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:15.962682 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:15.963218 30364 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:15.963932 30369 raft_consensus.cc:1275] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:15.966555 30367 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:15.922400 31970 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:16.449153 30478 raft_consensus.cc:1240] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
W20260807 07:57:16.215245 32157 log.cc:927] Time spent T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.187s user 0.000s sys 0.001s
I20260807 07:57:15.943076 30584 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
W20260807 07:57:16.258567 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:16.109946 30367 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
W20260807 07:57:16.188266 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:16.324819 31942 raft_consensus.cc:3055] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:16.462222 31942 raft_consensus.cc:740] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:16.463512 31942 consensus_queue.cc:260] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:16.464537 31942 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:16.217741 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.036728 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.466023 30578 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:16.058127 32075 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:16.027616 30487 raft_consensus.cc:2393] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
W20260807 07:57:16.350291 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:16.469734 32012 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:16.470310 32012 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:16.472194 32012 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:15.992012 30360 raft_consensus.cc:1240] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:16.115943 30364 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:16.279129 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:15.987493 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:16.484160 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:16.484959 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:16.486020 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:16.486701 30367 raft_consensus.cc:2468] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:15.991905 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:16.482928 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:57:16.180480 32161 log.cc:927] Time spent T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.230s user 0.001s sys 0.001s
I20260807 07:57:16.488155 30582 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:16.478765 30488 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:16.490723 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:16.492077 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:16.303170 32166 log.cc:927] Time spent T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.182s user 0.001s sys 0.000s
I20260807 07:57:16.492123 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:16.497680 30364 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:16.518565 30588 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:16.507678 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.509362 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.519955 30590 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:16.509999 30587 raft_consensus.cc:1240] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:16.520383 30367 raft_consensus.cc:3060] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:16.523700 31970 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:16.531443 30539 leader_election.cc:400] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:16.531836 30539 leader_election.cc:403] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:57:16.542464 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:16.544327 30587 raft_consensus.cc:1275] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:16.545759 30587 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:16.546169 30369 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:16.508678 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.497562 32012 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:16.547083 32012 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:16.549031 30588 raft_consensus.cc:1240] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:16.550309 30373 raft_consensus.cc:2393] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:16.529947 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:16.551046 31385 raft_consensus.cc:2393] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:57:16.560515 30588 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:16.549983 31966 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:16.536387 31970 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:16.561887 30476 raft_consensus.cc:1240] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:16.575827 30588 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:16.576762 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:16.584908 30364 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 3.
W20260807 07:57:16.587682 30429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s user 0.012s sys 0.021s
I20260807 07:57:16.569350 31849 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:16.576860 30579 raft_consensus.cc:2410] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260807 07:57:16.589777 30429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s user 0.013s sys 0.021s
I20260807 07:57:16.590878 30587 raft_consensus.cc:1275] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 07:57:16.590999 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 560378us
I20260807 07:57:16.598925 30367 raft_consensus.cc:2468] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 3.
I20260807 07:57:16.593253 32012 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:16.602181 31849 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:16.603267 30221 catalog_manager.cc:5697] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index 2 to 3, term changed from 1 to 2, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to <none>, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:16.604653 31849 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:16.605877 30365 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:16.607236 30365 raft_consensus.cc:1240] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 07:57:16.609480 30364 raft_consensus.cc:1240] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:16.569945 31966 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:16.614990 30587 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:16.614048 31849 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:57:16.628804 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.632124 30585 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 07:57:16.637329 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 157606us
I20260807 07:57:16.644918 30587 raft_consensus.cc:1275] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:16.648651 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.649127 30585 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:16.637250 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:16.631633 31338 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:16.634464 31849 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:16.661837 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.662774 30488 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:16.664784 30317 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:16.674422 30320 leader_election.cc:336] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.598s (SENT)
I20260807 07:57:16.680456 30320 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:16.682350 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.682825 30587 raft_consensus.cc:2376] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2. Re-sending same reply.
I20260807 07:57:16.674216 32148 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:16.692289 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.692128 30581 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:16.673599 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:16.667203 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 44796.3us
I20260807 07:57:16.701719 30585 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:16.703794 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.715498 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:16.717519 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 194198us
I20260807 07:57:16.726229 30367 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:16.746009 30588 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:16.749958 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.750670 30588 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:16.759408 32140 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:16.759938 32140 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:16.700431 32178 consensus_queue.cc:1048] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260807 07:57:16.747800 31966 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:16.780656 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.782408 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.783147 30588 raft_consensus.cc:2393] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:16.779963 32012 consensus_queue.cc:1059] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260807 07:57:16.785006 32140 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:16.778373 32184 log.cc:927] Time spent T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.142s user 0.001s sys 0.000s
I20260807 07:57:16.790412 30364 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 07:57:16.786586 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 67441.4us
I20260807 07:57:16.775959 32189 raft_consensus.cc:2804] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:16.798678 30582 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:16.769137 31338 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
I20260807 07:57:16.782250 31966 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:16.815253 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.816119 30588 raft_consensus.cc:2393] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:16.811010 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.817440 30579 raft_consensus.cc:2376] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3. Re-sending same reply.
W20260807 07:57:16.817866 32190 log.cc:927] Time spent T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.097s user 0.000s sys 0.000s
I20260807 07:57:16.819772 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.821969 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:16.814558 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 149840us
I20260807 07:57:16.823387 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:16.811105 32185 log.cc:927] Time spent T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.156s user 0.000s sys 0.001s
I20260807 07:57:16.822520 30588 raft_consensus.cc:2376] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3. Re-sending same reply.
W20260807 07:57:16.826063 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 151641us
I20260807 07:57:16.782688 32197 raft_consensus.cc:2955] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:16.838083 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.838660 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.839154 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.840224 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.840832 30588 raft_consensus.cc:2368] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3.
I20260807 07:57:16.841982 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.842286 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:16.825821 32188 log.cc:927] Time spent T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.098s user 0.001s sys 0.000s
I20260807 07:57:16.839211 30586 raft_consensus.cc:2376] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4. Re-sending same reply.
I20260807 07:57:16.831460 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.844304 30588 raft_consensus.cc:2393] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:16.845873 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.847091 30588 raft_consensus.cc:2376] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3. Re-sending same reply.
I20260807 07:57:16.826189 32198 raft_consensus.cc:2804] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:16.841771 30221 catalog_manager.cc:5697] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 2, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
W20260807 07:57:16.820089 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 70545.5us
I20260807 07:57:16.860136 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.828995 31849 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:16.876425 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.860074 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.877089 30585 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:16.860838 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.881167 30223 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40988 (request call id 38) took 3536 ms. Trace:
I20260807 07:57:16.881609 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.894255 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.894910 30585 raft_consensus.cc:2393] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:16.895613 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.896550 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.897017 30585 raft_consensus.cc:2376] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3. Re-sending same reply.
I20260807 07:57:16.857482 30578 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:16.881927 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:16.882921 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:16.886834 32192 log.cc:927] Time spent T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.109s user 0.001s sys 0.000s
I20260807 07:57:16.881215 30221 catalog_manager.cc:5697] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:16.889068 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.890933 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.905855 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33916 (request call id 809) took 1123 ms. Trace:
I20260807 07:57:16.902807 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.906340 30478 rpcz_store.cc:276] 0807 07:57:15.782608 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:15.821114 (+ 38506us) service_pool.cc:224] Handling call
0807 07:57:15.823007 (+ 1893us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:16.459717 (+636710us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:16.905614 (+445897us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b540025bf54. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:16.905793 (+ 179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439448320}
W20260807 07:57:16.911219 32217 log.cc:927] Time spent T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.129s user 0.001s sys 0.000s
I20260807 07:57:16.910933 30221 catalog_manager.cc:5697] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:16.912449 30221 catalog_manager.cc:5697] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 3, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:16.921691 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.904452 31871 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:16.922776 30585 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 07:57:16.923363 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:16.923807 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:16.924567 30429 leader_election.cc:336] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.523s (SENT)
I20260807 07:57:16.924500 30590 raft_consensus.cc:1275] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:16.940948 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.941694 30590 raft_consensus.cc:2368] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:16.942560 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.926802 30588 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:16.899910 32198 raft_consensus.cc:697] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:57:16.945123 32198 consensus_queue.cc:237] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:16.943833 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.949287 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.950069 30588 raft_consensus.cc:2410] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 07:57:16.950762 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.952001 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.953042 30590 raft_consensus.cc:2393] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:16.954593 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.955016 30588 raft_consensus.cc:2368] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:16.957329 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:16.958083 30590 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:16.959213 30590 raft_consensus.cc:1240] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:16.956475 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.924577 30579 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:16.965036 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:16.965632 30585 raft_consensus.cc:2376] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4. Re-sending same reply.
W20260807 07:57:16.967181 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:16.969918 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:16.975440 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:16.976303 30366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45054 (request call id 735) took 1046 ms. Trace:
I20260807 07:57:16.976609 30366 rpcz_store.cc:276] 0807 07:57:15.929394 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:15.929530 (+ 136us) service_pool.cc:224] Handling call
0807 07:57:16.975272 (+1045742us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b58001b0c98. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b83d2 00007fd6bb124219 00007fd6ba277640 00007fd6ba33febb 00007fd6ba33ff41 00007fd6ba2edeb0 00007fd6ba2ed794 00007fd6b3836834 00007fd6b38367c2
0807 07:57:16.976222 (+ 950us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12651776}
I20260807 07:57:16.980618 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:16.982887 30539 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:16.984608 32178 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:16.983844 30487 raft_consensus.cc:2955] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:16.985092 32178 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:16.985877 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:16.986665 30363 raft_consensus.cc:2393] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:57:16.987120 32178 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:16.990295 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.000862 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:17.001530 30478 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:16.987093 30363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45046 (request call id 900) took 1024 ms. Trace:
I20260807 07:57:17.004330 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:17.005863 30320 leader_election.cc:336] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.522s (SENT)
I20260807 07:57:17.007254 30586 raft_consensus.cc:2393] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:16.892659 30223 rpcz_store.cc:276] 0807 07:57:13.350162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:13.356876 (+ 6714us) service_pool.cc:224] Handling call
0807 07:57:13.418804 (+ 61928us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b54002a1a54. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b5260470 00007fd6b52ff31a 00007fd6bb0ef38c 00007fd6bb1ebbfe 00007fd6b96a54a4 00007fd6b96a5432 00007fd6b96a5361 00007fd6b96a52dc 00007fd6b96a4592 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:16.858706 (+3439902us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:14.297119 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:14.298136 (+ 1017us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:14.298203 (+ 67us) write_op.cc:435] Acquired schema lock
0807 07:57:14.298255 (+ 52us) tablet.cc:662] Decoding operations
0807 07:57:14.299017 (+ 762us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:14.299147 (+ 130us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:14.299186 (+ 39us) tablet.cc:685] Acquiring locks for 2 operations
0807 07:57:14.484463 (+185277us) tablet.cc:701] Row locks acquired
0807 07:57:14.484511 (+ 48us) write_op.cc:260] PREPARE: finished
0807 07:57:14.484818 (+ 307us) write_op.cc:270] Start()
0807 07:57:14.484990 (+ 172us) write_op.cc:276] Timestamp: P: 1786089434484730 usec, L: 0
0807 07:57:14.485035 (+ 45us) op_driver.cc:348] REPLICATION: starting
0807 07:57:14.486225 (+ 1190us) log.cc:844] Serialized 918 byte log entry
0807 07:57:15.323870 (+837645us) op_driver.cc:464] REPLICATION: finished
0807 07:57:15.674263 (+350393us) write_op.cc:301] APPLY: starting
0807 07:57:15.674368 (+ 105us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:15.674512 (+ 144us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:15.674656 (+ 144us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:15.675204 (+ 548us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:15.675504 (+ 300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 07:57:15.675561 (+ 57us) write_op.cc:312] APPLY: finished
0807 07:57:15.675830 (+ 269us) log.cc:844] Serialized 28 byte log entry
0807 07:57:15.676039 (+ 209us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:15.676128 (+ 89us) write_op.cc:454] Released schema lock
0807 07:57:15.676191 (+ 63us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:15.676728 (+ 537us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:15.676756 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11163,"reported_tablets":3,"spinlock_wait_cycles":21436672,"child_traces":[["op",{"apply.queue_time_us":350122,"apply.run_cpu_time_us":2442,"apply.run_wall_time_us":2442,"num_ops":2,"prepare.queue_time_us":547780,"prepare.run_cpu_time_us":20457,"prepare.run_wall_time_us":406298,"raft.queue_time_us":320262,"raft.run_cpu_time_us":27092,"raft.run_wall_time_us":263671,"replication_time_us":827355,"thread_start_us":990011,"threads_started":4,"wal-append.queue_time_us":269434,"wal-append.run_cpu_time_us":40925,"wal-append.run_wall_time_us":1919907}]]}
I20260807 07:57:17.008862 32012 consensus_queue.cc:1243] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Peer ef1ca7acf52a438f89f14707e9e06818 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260807 07:57:17.019536 30320 leader_election.cc:336] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.600s (SENT)
I20260807 07:57:17.019999 30320 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:17.020658 30586 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 2 index: 2. (term mismatch)
I20260807 07:57:17.021054 30586 pending_rounds.cc:85] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e: Aborting all ops after (but not including) 1
I20260807 07:57:17.021258 30586 pending_rounds.cc:107] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 07:57:17.021487 30586 raft_consensus.cc:2889] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:17.010618 32189 raft_consensus.cc:697] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
W20260807 07:57:17.077389 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 169411us
W20260807 07:57:17.078118 30429 leader_election.cc:336] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.635s (SENT)
I20260807 07:57:17.078473 30429 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:17.085335 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.086218 30586 raft_consensus.cc:2393] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:17.006824 30363 rpcz_store.cc:276] 0807 07:57:15.962940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:15.965507 (+ 2567us) service_pool.cc:224] Handling call
0807 07:57:16.761655 (+796148us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b58001b0c98. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b83d2 00007fd6bb124219 00007fd6ba277640 00007fd6ba33febb 00007fd6ba33ff41 00007fd6ba2edeb0 00007fd6ba2ed794 00007fd6b3836834 00007fd6b38367c2
0807 07:57:16.985762 (+224107us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b58001b0c98. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b889e 000000000038d209 00007fd6ba277940 00007fd6ba33fed4 00007fd6ba33ff41 00007fd6ba2edeb0 00007fd6ba2ed794 00007fd6b3836834 00007fd6b38367c2
0807 07:57:16.987042 (+ 1280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18583040}
W20260807 07:57:17.130605 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 52517.4us
W20260807 07:57:17.131302 30429 leader_election.cc:336] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.637s (SENT)
I20260807 07:57:17.131664 30429 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:17.073729 32140 raft_consensus.cc:2749] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:17.135483 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 149882us
I20260807 07:57:17.163733 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:17.135743 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.171160 30586 raft_consensus.cc:2393] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:17.165031 30539 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:17.077162 32230 raft_consensus.cc:2749] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:17.174957 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:17.199278 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 179772us
I20260807 07:57:17.200783 31839 raft_consensus.cc:2749] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:17.203378 30478 raft_consensus.cc:2393] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
W20260807 07:57:17.210194 30320 leader_election.cc:336] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.610s (SENT)
I20260807 07:57:17.186480 32201 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:57:17.217614 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 86338.2us
I20260807 07:57:17.202729 32244 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:17.221906 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 56938.7us
W20260807 07:57:17.223047 30429 leader_election.cc:336] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.648s (SENT)
I20260807 07:57:17.228652 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:17.230744 32235 log.cc:927] Time spent T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.050s user 0.000s sys 0.000s
I20260807 07:57:17.225307 32244 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:17.232647 32191 log.cc:927] Time spent T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.535s user 0.010s sys 0.000s
I20260807 07:57:17.233494 32244 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:17.236814 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:17.237486 30360 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:17.238466 30320 leader_election.cc:336] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.612s (SENT)
W20260807 07:57:17.240077 30429 leader_election.cc:336] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.670s (SENT)
I20260807 07:57:17.219401 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.243522 30429 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:17.225692 32230 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:17.248615 32000 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:17.249281 30429 leader_election.cc:336] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.679s (SENT)
I20260807 07:57:17.194977 32189 consensus_queue.cc:237] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.250958 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.226938 32243 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:17.262099 30587 raft_consensus.cc:2376] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2. Re-sending same reply.
I20260807 07:57:17.250716 30429 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
W20260807 07:57:17.263595 30320 leader_election.cc:336] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.675s (SENT)
I20260807 07:57:17.265460 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.266137 30585 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
W20260807 07:57:17.271818 32237 log.cc:927] Time spent T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.197s user 0.001s sys 0.000s
W20260807 07:57:17.249567 32219 log.cc:927] Time spent T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.215s user 0.000s sys 0.001s
I20260807 07:57:17.270944 32174 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:17.222656 32201 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.249330 32000 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 07:57:17.282833 30320 leader_election.cc:336] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.745s (SENT)
I20260807 07:57:17.264761 32243 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:17.295116 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.297537 30320 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
W20260807 07:57:17.294683 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 61115.5us
I20260807 07:57:17.306098 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:17.306049 32174 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.301244 31871 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:17.277835 31839 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:17.310809 32232 log.cc:927] Time spent T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.091s user 0.000s sys 0.000s
I20260807 07:57:17.315703 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.320240 30579 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:17.321774 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.322075 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.322489 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.323139 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:17.324849 32253 log.cc:927] Time spent T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.091s user 0.000s sys 0.001s
I20260807 07:57:17.325747 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.359392 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:17.340412 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 114445us
I20260807 07:57:17.282356 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.360669 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.361263 30582 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
W20260807 07:57:17.347489 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 68019.9us
I20260807 07:57:17.348766 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.362367 30585 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
W20260807 07:57:17.362392 30320 leader_election.cc:336] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.782s (SENT)
I20260807 07:57:17.362970 30320 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:17.365866 30588 raft_consensus.cc:2393] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:17.334203 32243 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:17.280963 32230 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.346549 32247 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:17.376137 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.359952 30587 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:17.371665 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.339694 32201 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:17.372581 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:17.401010 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:17.368325 30358 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:17.373493 31385 raft_consensus.cc:2955] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:17.370342 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.391721 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.392848 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.371562 30372 raft_consensus.cc:1275] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:17.347842 31966 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:17.394013 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.395787 30479 raft_consensus.cc:1217] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2] Dedup: 3.2->[]
I20260807 07:57:17.396406 30429 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:17.412667 30479 raft_consensus.cc:1240] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 07:57:17.398377 30585 raft_consensus.cc:2368] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 3. Current term is 4.
I20260807 07:57:17.399930 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.401922 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:17.414726 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.394752 32226 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:17.416880 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:17.417408 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 55032.2us
W20260807 07:57:17.421204 30320 leader_election.cc:336] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.784s (SENT)
I20260807 07:57:17.418421 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.423554 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.423075 32255 consensus_queue.cc:1059] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260807 07:57:17.424419 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.426641 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.427953 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.424522 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.428651 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.432934 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.434402 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.419742 31839 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:17.435901 30585 raft_consensus.cc:2393] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:17.436820 30587 raft_consensus.cc:2393] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:17.414351 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:17.423586 30579 raft_consensus.cc:2393] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:17.432301 30584 raft_consensus.cc:2393] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:17.444442 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.444526 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.450356 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.451998 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.452661 30587 raft_consensus.cc:2393] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:17.398029 32247 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.424937 32025 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260807 07:57:17.423704 30360 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:17.456174 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.456827 30582 raft_consensus.cc:2393] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:17.456789 30479 raft_consensus.cc:1275] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:17.458119 30582 raft_consensus.cc:1240] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:17.460381 32247 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:17.461565 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:17.462615 30581 raft_consensus.cc:3055] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:17.462940 30581 raft_consensus.cc:740] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:17.464036 32174 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:17.465420 32230 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:17.466089 30360 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45054 (request call id 752) took 1432 ms (client timeout 1689 ms). Trace:
W20260807 07:57:17.466506 30360 rpcz_store.cc:269] 0807 07:57:16.034029 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:16.477654 (+443625us) service_pool.cc:224] Handling call
0807 07:57:17.236655 (+759001us) spinlock_profiling.cc:243] Waited 6.78 ms on lock 0x7b58001b0c98. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b83d2 00007fd6bb124219 00007fd6ba277640 00007fd6ba33febb 00007fd6ba33ff41 00007fd6ba2edeb0 00007fd6ba2ed794 00007fd6b3836834 00007fd6b38367c2
0807 07:57:17.466013 (+229358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15583616}
I20260807 07:57:17.436976 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:17.468654 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 47485.1us
W20260807 07:57:17.469290 30320 leader_election.cc:336] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.792s (SENT)
I20260807 07:57:17.444303 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.445300 32255 consensus_queue.cc:1243] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Peer ef1ca7acf52a438f89f14707e9e06818 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 07:57:17.470160 30578 raft_consensus.cc:2368] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 4.
I20260807 07:57:17.431555 31338 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:17.433866 32265 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260807 07:57:17.474110 30578 raft_consensus.cc:1240] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:17.469684 30320 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:17.476761 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.502338 30586 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:17.503868 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 50670.3us
I20260807 07:57:17.504148 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.476720 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.508644 30585 raft_consensus.cc:2368] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:17.518883 30582 raft_consensus.cc:1240] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:17.519326 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.520152 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.518779 31970 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:17.527173 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.529356 30588 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:17.508339 32226 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:17.492080 31915 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260807 07:57:17.491737 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 68969.2us
I20260807 07:57:17.502890 31839 raft_consensus.cc:697] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:17.534286 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.540328 30579 raft_consensus.cc:1240] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:17.544278 31849 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:17.546046 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.547940 30581 consensus_queue.cc:260] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.561853 30587 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:17.548774 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.549592 30429 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:17.550559 32268 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:17.552520 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.557842 31915 consensus_queue.cc:1048] T 1f5785da4aac4398afc22beefd2bd76b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:17.559121 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:17.560930 30585 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:17.562286 30581 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:17.564581 30429 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:17.562269 30317 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:17.562644 30582 raft_consensus.cc:2368] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:17.566813 30584 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:17.567210 32268 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.568074 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:17.574010 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 104741us
W20260807 07:57:17.588639 30320 leader_election.cc:336] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.835s (SENT)
I20260807 07:57:17.589035 30320 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:17.593550 30587 raft_consensus.cc:2368] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:17.598121 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:17.573953 32277 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:17.607533 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:17.587657 32265 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:17.614782 30581 raft_consensus.cc:1275] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:17.615190 30586 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:17.616562 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:17.597397 31966 raft_consensus.cc:2749] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:17.638877 30585 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:17.588287 31849 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:17.626575 31942 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260807 07:57:17.649236 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 60627.8us
I20260807 07:57:17.617132 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:17.616325 32265 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:17.652595 30320 leader_election.cc:336] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.848s (SENT)
W20260807 07:57:17.653599 30541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:17.607028 32231 consensus_queue.cc:1048] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260807 07:57:17.640822 32277 consensus_queue.cc:1059] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 07:57:17.668437 32277 raft_consensus.cc:3055] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:17.668805 32277 raft_consensus.cc:740] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:17.676010 32268 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:17.619068 31839 consensus_queue.cc:237] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.650125 32226 raft_consensus.cc:2749] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:17.641920 30360 raft_consensus.cc:1240] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:17.664996 31849 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:17.683789 30320 leader_election.cc:336] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.850s (SENT)
I20260807 07:57:17.685428 30320 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
W20260807 07:57:17.684662 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 73378.7us
I20260807 07:57:17.688097 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:17.655484 32265 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:17.710012 32178 consensus_queue.cc:1059] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:17.711095 32178 raft_consensus.cc:3055] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:17.711421 32178 raft_consensus.cc:740] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:17.712235 32178 consensus_queue.cc:260] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.702543 32214 raft_consensus.cc:2749] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:17.657536 32243 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.715447 30578 raft_consensus.cc:2368] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5.
W20260807 07:57:17.724720 30320 leader_election.cc:336] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.852s (SENT)
I20260807 07:57:17.728228 32178 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:17.730583 30585 raft_consensus.cc:1275] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:17.732353 31915 consensus_queue.cc:1048] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:17.724190 32230 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:17.738605 32230 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.740545 32230 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:17.741823 32287 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:17.742349 32287 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:17.744231 30364 raft_consensus.cc:1275] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:17.745009 32287 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:17.745654 31915 consensus_queue.cc:1048] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:17.746445 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:17.752213 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:17.752439 32283 log.cc:927] Time spent T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260807 07:57:17.752888 30480 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:17.752889 31385 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:17.758462 32174 consensus_queue.cc:1059] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:17.759116 32243 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:17.705998 32277 consensus_queue.cc:260] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.760525 32277 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:17.755719 30541 connection.cc:256] RPC call timeout handler was delayed by -1.2476427007932216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
I20260807 07:57:17.762073 32269 consensus_queue.cc:1048] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 07:57:17.762619 30541 connection.cc:256] RPC call timeout handler was delayed by -1.2359427008777857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260807 07:57:17.762990 30541 connection.cc:256] RPC call timeout handler was delayed by -1.1900427008513361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260807 07:57:17.763286 30541 connection.cc:256] RPC call timeout handler was delayed by -1.1585427008103579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260807 07:57:17.763635 30541 connection.cc:256] RPC call timeout handler was delayed by -1.1108427008148283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260807 07:57:17.763952 30541 connection.cc:256] RPC call timeout handler was delayed by -1.0910427009221166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260807 07:57:17.764218 30541 connection.cc:256] RPC call timeout handler was delayed by -1.0001427009701729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
I20260807 07:57:17.767594 32264 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:17.756541 32012 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:17.767894 32000 consensus_queue.cc:1059] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:17.768568 32012 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.768991 32000 raft_consensus.cc:3055] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:17.769410 32000 raft_consensus.cc:740] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:17.763468 32284 log.cc:927] Time spent T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.170s user 0.002s sys 0.000s
I20260807 07:57:17.770354 30323 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:17.773895 30320 leader_election.cc:336] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.889s (SENT)
I20260807 07:57:17.781044 30541 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:17.770288 32000 consensus_queue.cc:260] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.784122 32000 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:17.767840 32174 raft_consensus.cc:3055] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:17.784381 31871 raft_consensus.cc:2764] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260807 07:57:17.777354 32189 raft_consensus.cc:2804] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:17.786617 32189 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:17.786979 32189 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:17.785406 30320 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:17.784581 30541 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:17.786158 32174 raft_consensus.cc:740] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:17.766084 31923 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260807 07:57:17.796481 32254 raft_consensus.cc:2749] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:17.797833 30541 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:17.798667 32254 raft_consensus.cc:2804] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:17.799008 32254 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:17.799301 32254 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:17.806697 32174 consensus_queue.cc:260] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.808113 32174 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:17.811331 32254 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.813462 32254 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:17.814533 30541 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:17.816274 32265 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.816840 32254 raft_consensus.cc:2749] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:17.816380 30541 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:17.819849 32012 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:17.820107 32254 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:17.821060 32254 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:17.821870 32254 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:17.817644 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:17.819787 30541 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:17.863988 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 69913.4us
I20260807 07:57:17.867149 30541 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:17.868043 32194 raft_consensus.cc:2749] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:17.866056 32287 raft_consensus.cc:2749] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:17.870584 32194 consensus_queue.cc:1059] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:17.871740 32268 raft_consensus.cc:3055] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:17.872076 32268 raft_consensus.cc:740] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:17.873561 32265 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:17.872915 32268 consensus_queue.cc:260] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:17.872694 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 106060us
I20260807 07:57:17.878396 32268 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:17.878897 30320 leader_election.cc:336] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.928s (SENT)
I20260807 07:57:17.879314 30320 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:17.882994 32287 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:17.886415 30541 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:17.889225 32194 raft_consensus.cc:2749] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:17.889989 32194 consensus_queue.cc:1048] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:17.891144 30220 catalog_manager.cc:5697] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:17.864562 31942 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:17.886662 30221 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53640 (request call id 171) took 2902 ms. Trace:
I20260807 07:57:17.898074 32194 consensus_queue.cc:1059] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:17.898902 32194 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:17.899364 32189 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:17.899756 31942 raft_consensus.cc:3055] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:17.900564 31942 raft_consensus.cc:740] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:17.899642 30220 catalog_manager.cc:5697] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:17.901316 31942 consensus_queue.cc:260] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:17.903594 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:17.905835 31942 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:17.906765 30220 catalog_manager.cc:5697] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:17.912194 30220 catalog_manager.cc:5697] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
W20260807 07:57:17.908849 30320 leader_election.cc:336] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.990s (SENT)
I20260807 07:57:17.904166 30541 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:17.915320 30320 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:17.915683 32194 raft_consensus.cc:2749] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:17.916515 32287 raft_consensus.cc:2749] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:17.917274 30541 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:17.897492 30221 rpcz_store.cc:276] 0807 07:57:14.984145 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:14.984417 (+ 272us) service_pool.cc:224] Handling call
0807 07:57:17.886599 (+2902182us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:17.301832 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:17.302561 (+ 729us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:17.302630 (+ 69us) write_op.cc:435] Acquired schema lock
0807 07:57:17.302648 (+ 18us) tablet.cc:662] Decoding operations
0807 07:57:17.303383 (+ 735us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:17.303488 (+ 105us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:17.303521 (+ 33us) tablet.cc:685] Acquiring locks for 5 operations
0807 07:57:17.304073 (+ 552us) tablet.cc:701] Row locks acquired
0807 07:57:17.304094 (+ 21us) write_op.cc:260] PREPARE: finished
0807 07:57:17.304246 (+ 152us) write_op.cc:270] Start()
0807 07:57:17.304366 (+ 120us) write_op.cc:276] Timestamp: P: 1786089437304196 usec, L: 0
0807 07:57:17.304383 (+ 17us) op_driver.cc:348] REPLICATION: starting
0807 07:57:17.401444 (+ 97061us) log.cc:844] Serialized 2117 byte log entry
0807 07:57:17.557126 (+155682us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b54002a1a54. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f2208 00007fd6b8d4bf61 00007fd6b8d4b738 00007fd6b8d503d1 00007fd6b8d50389 00007fd6b8d50319 00007fd6b8d502e1 00007fd6b8d4f50d 00000000003aa554 00000000003aa399
0807 07:57:17.674454 (+117328us) op_driver.cc:464] REPLICATION: finished
0807 07:57:17.697033 (+ 22579us) write_op.cc:301] APPLY: starting
0807 07:57:17.697125 (+ 92us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:17.697305 (+ 180us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:17.697328 (+ 23us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:17.698105 (+ 777us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:17.698307 (+ 202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0807 07:57:17.698358 (+ 51us) write_op.cc:312] APPLY: finished
0807 07:57:17.698598 (+ 240us) log.cc:844] Serialized 46 byte log entry
0807 07:57:17.698779 (+ 181us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:17.698887 (+ 108us) write_op.cc:454] Released schema lock
0807 07:57:17.698933 (+ 46us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:17.699290 (+ 357us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:17.699318 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":620258,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":22144,"apply.run_cpu_time_us":2244,"apply.run_wall_time_us":2245,"num_ops":5,"prepare.queue_time_us":327292,"prepare.run_cpu_time_us":25510,"prepare.run_wall_time_us":255527,"raft.queue_time_us":125849,"raft.run_cpu_time_us":10364,"raft.run_wall_time_us":22517,"replication_time_us":369925,"spinlock_wait_cycles":71425536,"thread_start_us":358886,"threads_started":4,"wal-append.queue_time_us":136413}]]}
I20260807 07:57:17.918164 32194 raft_consensus.cc:2749] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 07:57:17.918377 30320 leader_election.cc:336] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 2.013s (SENT)
I20260807 07:57:17.919283 30541 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:17.927714 30482 raft_consensus.cc:1240] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:17.975659 30320 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:17.931174 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:17.976099 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 56909.6us
W20260807 07:57:17.934541 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:17.976897 30541 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:17.935055 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:17.937621 30476 raft_consensus.cc:1240] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:17.938344 32189 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:17.938545 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:17.939544 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:17.909149 32254 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.943152 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:17.944129 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:17.946949 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:17.929466 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:17.913769 30220 catalog_manager.cc:5697] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:17.982589 30488 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:17.979245 30489 raft_consensus.cc:1275] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:17.983783 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:17.984418 30478 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:17.985265 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:17.986088 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 221981us
I20260807 07:57:17.981534 31385 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:17.990072 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 71727.7us
W20260807 07:57:17.990667 30320 leader_election.cc:336] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 2.021s (SENT)
I20260807 07:57:17.990998 30320 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:17.991434 32174 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:17.981861 31849 raft_consensus.cc:2749] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:17.992111 30220 catalog_manager.cc:5697] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:17.993574 32287 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:17.993947 30488 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:17.993848 30220 catalog_manager.cc:5697] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:17.995322 30220 catalog_manager.cc:5697] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:17.997493 30541 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:17.998328 31849 raft_consensus.cc:2749] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:17.998697 32000 consensus_queue.cc:1048] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:17.999387 30539 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:18.000231 32243 consensus_queue.cc:1059] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:18.000946 32243 consensus_queue.cc:1243] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [LEADER]: Peer ef1ca7acf52a438f89f14707e9e06818 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260807 07:57:18.001400 32243 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:18.001848 32243 raft_consensus.cc:697] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:18.002650 32243 consensus_queue.cc:237] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:17.981101 32268 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.005594 32296 raft_consensus.cc:3055] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:18.006011 32296 raft_consensus.cc:740] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:18.006096 30220 catalog_manager.cc:5697] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 2 to 3, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:17.998179 32012 consensus_queue.cc:1059] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:18.007915 32012 raft_consensus.cc:3055] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:18.008281 32012 raft_consensus.cc:740] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:18.009589 31871 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.009050 32012 consensus_queue.cc:260] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.010618 32012 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:18.006976 32254 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:18.011634 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:57:17.998657 30320 leader_election.cc:336] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 2.023s (SENT)
I20260807 07:57:18.013741 30320 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.013968 32206 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 07:57:18.014808 30320 leader_election.cc:336] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 2.048s (SENT)
I20260807 07:57:18.015213 30320 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.015869 31966 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:18.016191 30320 leader_election.cc:336] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 2.096s (SENT)
I20260807 07:57:18.006857 32296 consensus_queue.cc:260] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.017773 32296 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:18.017414 30220 catalog_manager.cc:5697] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:18.019610 30220 catalog_manager.cc:5697] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:18.016482 31966 raft_consensus.cc:2749] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.023380 31942 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.016438 30541 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:18.025458 30320 leader_election.cc:336] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 2.100s (SENT)
I20260807 07:57:18.026703 30320 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
W20260807 07:57:18.028328 30320 leader_election.cc:336] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 2.106s (SENT)
I20260807 07:57:18.009825 31385 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
W20260807 07:57:18.029488 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:18.029876 32254 raft_consensus.cc:2749] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.030388 30320 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.030339 30541 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:18.031745 32254 raft_consensus.cc:2749] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.032224 30541 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:18.033021 32254 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:18.011725 30478 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:18.030697 31966 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:17.980610 32194 consensus_queue.cc:1059] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260807 07:57:18.033705 32254 raft_consensus.cc:697] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 2 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:18.030640 31942 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260807 07:57:18.034242 32194 raft_consensus.cc:3055] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:18.034618 32194 raft_consensus.cc:740] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:18.034756 32254 consensus_queue.cc:237] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.035542 32194 consensus_queue.cc:260] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.036547 30323 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:18.037336 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.037955 30585 raft_consensus.cc:2376] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4. Re-sending same reply.
I20260807 07:57:18.039776 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.040325 30585 raft_consensus.cc:2376] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4. Re-sending same reply.
I20260807 07:57:18.041590 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.042611 32287 raft_consensus.cc:2749] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.043573 32264 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 07:57:18.043877 30320 leader_election.cc:336] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 2.125s (SENT)
I20260807 07:57:18.044389 30320 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
W20260807 07:57:18.045548 30320 leader_election.cc:336] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f831a53ec51d452398015797d543164e (127.27.64.131:33207): Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 2.126s (SENT)
I20260807 07:57:18.046128 32264 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 07:57:18.046353 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:18.047294 32287 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.048084 31849 raft_consensus.cc:2804] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:18.048827 31849 raft_consensus.cc:697] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:18.049491 30220 catalog_manager.cc:5697] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:18.049768 31849 consensus_queue.cc:237] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:18.050838 30220 catalog_manager.cc:5697] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:18.048082 32189 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:18.053788 32189 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.058319 32189 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:18.060108 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.060997 30585 raft_consensus.cc:2410] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:18.062561 30585 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:18.064067 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.064862 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.066361 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.066973 30590 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:18.068426 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:18.058959 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:18.068974 30590 raft_consensus.cc:2376] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4. Re-sending same reply.
I20260807 07:57:18.069450 30478 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:18.070290 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.070922 30590 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:18.070989 30317 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:18.071895 32289 raft_consensus.cc:2804] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:18.072155 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:18.073282 32289 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:18.073724 32289 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:18.074143 32300 consensus_queue.cc:1048] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:18.076841 30429 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.079097 30429 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.080696 32289 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.079507 30590 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:18.079628 32300 raft_consensus.cc:2749] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.084188 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:18.096293 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.097021 30590 raft_consensus.cc:2393] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:18.098040 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.084980 32289 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:18.099342 30588 raft_consensus.cc:2376] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3. Re-sending same reply.
I20260807 07:57:18.099010 30488 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:18.100768 30317 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:18.106583 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.107493 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.108018 30581 raft_consensus.cc:2376] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3. Re-sending same reply.
I20260807 07:57:18.108862 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:18.109439 30578 raft_consensus.cc:2376] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4. Re-sending same reply.
I20260807 07:57:18.107189 30586 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:18.107199 32300 raft_consensus.cc:2749] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.112741 32287 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:18.036679 32194 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:18.114574 30320 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.115451 32231 raft_consensus.cc:2749] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.115736 30320 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.116863 30320 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.117451 31966 raft_consensus.cc:2804] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:18.117621 32189 raft_consensus.cc:2749] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.111564 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.122257 30587 raft_consensus.cc:1275] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:18.122802 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.123250 30578 raft_consensus.cc:2376] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3. Re-sending same reply.
I20260807 07:57:18.125862 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.126427 30587 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:18.129251 30320 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.135813 32226 raft_consensus.cc:2749] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.129629 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.136543 30588 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:18.131067 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.137295 30320 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.131852 30429 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.138151 32226 raft_consensus.cc:2749] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.138507 32300 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.138797 30429 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.139696 32300 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.140085 30429 leader_election.cc:400] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3.
I20260807 07:57:18.139744 32226 consensus_queue.cc:1059] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:18.140367 30429 leader_election.cc:403] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 07:57:18.140930 32300 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3.
I20260807 07:57:18.132444 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.141218 32189 raft_consensus.cc:3055] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:18.132786 31966 raft_consensus.cc:697] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:18.137660 30584 raft_consensus.cc:2410] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:18.142408 30429 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:57:18.141680 32189 raft_consensus.cc:740] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:18.142617 30320 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.154330 30429 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.146129 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.158916 30590 raft_consensus.cc:2393] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:18.122246 32287 raft_consensus.cc:2749] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.160953 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:18.167785 30582 raft_consensus.cc:2393] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:18.168257 31849 raft_consensus.cc:2749] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.168363 32189 consensus_queue.cc:260] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.169586 32189 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:18.157823 32300 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.177726 30320 leader_election.cc:400] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 4.
I20260807 07:57:18.178426 30429 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:18.162214 32264 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:18.196702 32300 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:18.197118 32300 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:18.196000 31966 consensus_queue.cc:237] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.201485 30585 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:18.208658 32300 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:18.216904 32287 consensus_queue.cc:1059] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:18.218012 32287 raft_consensus.cc:3055] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:18.218366 32287 raft_consensus.cc:740] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:18.219130 32287 consensus_queue.cc:260] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.220496 32287 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:18.217089 30320 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.220436 32300 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:18.231966 32300 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:18.219168 30429 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.234881 30320 leader_election.cc:400] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:18.227212 32289 raft_consensus.cc:2749] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.241168 32264 raft_consensus.cc:2749] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.245082 30429 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.242990 32300 raft_consensus.cc:2749] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.247174 32174 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:18.248991 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:18.252763 30488 raft_consensus.cc:1240] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:18.262523 30429 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.264660 30320 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.266201 32289 consensus_queue.cc:1059] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:18.265249 32264 raft_consensus.cc:2749] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.269083 32289 raft_consensus.cc:3055] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:18.272365 30320 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.266247 32189 consensus_queue.cc:1059] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260807 07:57:18.274804 30320 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:18.271961 32289 raft_consensus.cc:740] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:18.272801 31849 raft_consensus.cc:2749] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:18.277052 32289 consensus_queue.cc:260] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.278252 32289 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:18.282207 32189 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:18.282982 32189 raft_consensus.cc:3055] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:18.283313 32189 raft_consensus.cc:740] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:18.284163 32189 consensus_queue.cc:260] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.286118 30429 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.287087 32264 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.287533 30429 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.288347 32264 raft_consensus.cc:2749] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.291543 32289 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:18.291950 32289 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:18.292320 32289 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:18.297983 30320 leader_election.cc:400] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:18.298292 30320 leader_election.cc:403] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:57:18.297587 32189 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:18.301200 30429 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.310220 30429 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.310866 32174 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:18.311666 30320 leader_election.cc:400] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:18.312009 30320 leader_election.cc:403] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:57:18.308147 31966 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:18.316023 31849 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:18.315666 32174 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:18.328172 30429 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:18.333580 32264 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:18.333746 32000 consensus_queue.cc:1048] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:18.334362 30429 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:18.332860 30320 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.330873 32289 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.335505 32000 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:18.335456 30429 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:57:18.335774 32265 raft_consensus.cc:2764] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260807 07:57:18.337823 32000 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:18.340006 32000 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:18.340390 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:18.347090 32000 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.349159 32000 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:18.338001 32189 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:18.333400 32174 raft_consensus.cc:2749] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.339676 32289 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:18.337042 30320 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:18.363112 32289 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:18.363483 32289 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:18.363855 32289 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:18.366022 30320 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.365974 30221 catalog_manager.cc:5697] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:18.367465 30220 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53656 (request call id 202) took 3237 ms. Trace:
I20260807 07:57:18.371357 32189 raft_consensus.cc:2749] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:18.365967 32194 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:18.367861 30221 catalog_manager.cc:5697] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:18.375144 32265 consensus_queue.cc:1048] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:18.375041 32194 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.376852 30320 leader_election.cc:400] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5.
I20260807 07:57:18.370062 32000 raft_consensus.cc:2749] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:18.367901 30220 rpcz_store.cc:276] 0807 07:57:15.129939 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:15.132034 (+ 2095us) service_pool.cc:224] Handling call
0807 07:57:18.367401 (+3235367us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:18.171664 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:18.172198 (+ 534us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:18.172234 (+ 36us) write_op.cc:435] Acquired schema lock
0807 07:57:18.172251 (+ 17us) tablet.cc:662] Decoding operations
0807 07:57:18.173281 (+ 1030us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:18.173338 (+ 57us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:18.173366 (+ 28us) tablet.cc:685] Acquiring locks for 13 operations
0807 07:57:18.206131 (+ 32765us) tablet.cc:701] Row locks acquired
0807 07:57:18.206154 (+ 23us) write_op.cc:260] PREPARE: finished
0807 07:57:18.206311 (+ 157us) write_op.cc:270] Start()
0807 07:57:18.206427 (+ 116us) write_op.cc:276] Timestamp: P: 1786089438206260 usec, L: 0
0807 07:57:18.206450 (+ 23us) op_driver.cc:348] REPLICATION: starting
0807 07:57:18.208240 (+ 1790us) log.cc:844] Serialized 5197 byte log entry
0807 07:57:18.276895 (+ 68655us) op_driver.cc:464] REPLICATION: finished
0807 07:57:18.320833 (+ 43938us) write_op.cc:301] APPLY: starting
0807 07:57:18.320948 (+ 115us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:18.321183 (+ 235us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:18.323691 (+ 2508us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:18.325123 (+ 1432us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:18.325346 (+ 223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0807 07:57:18.325417 (+ 71us) write_op.cc:312] APPLY: finished
0807 07:57:18.325762 (+ 345us) log.cc:844] Serialized 94 byte log entry
0807 07:57:18.325931 (+ 169us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:18.326078 (+ 147us) write_op.cc:454] Released schema lock
0807 07:57:18.326136 (+ 58us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:18.326516 (+ 380us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:18.326553 (+ 37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":39219,"apply.run_cpu_time_us":3423,"apply.run_wall_time_us":5957,"num_ops":13,"prepare.queue_time_us":37804,"prepare.run_cpu_time_us":4557,"prepare.run_wall_time_us":38998,"replication_time_us":68202,"thread_start_us":44793,"threads_started":2}]]}
I20260807 07:57:18.386736 32012 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:18.387130 32194 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:18.387270 32012 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.388537 30429 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.389335 32012 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:18.390645 30320 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:18.391420 32289 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.392310 32189 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:18.392700 32189 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:18.393071 32189 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:18.393546 32289 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:18.393698 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:18.392983 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:18.400080 32189 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.401077 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:18.403441 32189 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:18.404073 32265 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:18.406221 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:18.409722 32000 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:18.378613 30221 catalog_manager.cc:5697] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:18.413070 30221 catalog_manager.cc:5697] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:18.414501 30221 catalog_manager.cc:5697] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 3, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 3 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:18.415992 30221 catalog_manager.cc:5697] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 4, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 4 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:18.417938 30221 catalog_manager.cc:5697] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 3, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 3 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:18.421398 30221 catalog_manager.cc:5697] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:18.423578 30320 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:18.424352 32287 raft_consensus.cc:2804] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:18.424736 32287 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:18.425089 32287 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:18.425212 30320 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.426131 32189 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:18.420145 32289 consensus_queue.cc:1048] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:18.431623 32189 raft_consensus.cc:2749] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:18.432782 30320 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.418498 32265 raft_consensus.cc:2749] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:18.437191 30320 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:18.419188 30429 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.438071 32287 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.442183 32265 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:18.443109 32289 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:18.443717 32289 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:18.445667 32287 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:18.446108 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:18.462726 32289 raft_consensus.cc:2749] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 07:57:18.465099 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:18.465855 30429 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
W20260807 07:57:18.473904 30541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:18.474481 30367 raft_consensus.cc:1240] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:18.477424 32265 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 07:57:18.486672 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:18.499112 30367 raft_consensus.cc:1217] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2] Dedup: 3.2->[]
I20260807 07:57:18.499217 30582 raft_consensus.cc:1240] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 07:57:18.499725 30367 raft_consensus.cc:1240] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 07:57:18.503435 30367 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 07:57:18.504877 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:18.507890 30358 raft_consensus.cc:1240] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:18.510130 30365 raft_consensus.cc:1240] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:18.512843 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:18.513422 30365 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:18.533802 30488 raft_consensus.cc:1275] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:18.534233 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:18.538225 32296 consensus_queue.cc:1048] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:18.542733 30367 raft_consensus.cc:1240] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:18.547070 30365 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:18.549742 30585 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:18.551168 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.553144 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.554752 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.559554 30478 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:57:18.562150 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.564934 32296 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:18.565498 32296 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:18.567587 32296 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:18.561122 32289 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260807 07:57:18.570796 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:18.574059 30478 raft_consensus.cc:2955] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:18.586794 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:18.595613 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.598150 30365 raft_consensus.cc:2393] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:18.602226 30364 raft_consensus.cc:1275] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:18.602752 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:18.603727 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.605473 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:18.606030 30429 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:18.606519 30373 raft_consensus.cc:2393] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:18.614192 30586 raft_consensus.cc:1275] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:18.604806 30222 catalog_manager.cc:5697] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 3, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:18.618723 30429 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:18.620555 30366 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:18.632230 30364 raft_consensus.cc:1240] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:18.639057 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.632385 30222 catalog_manager.cc:5697] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 3, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:18.644631 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.601881 30363 raft_consensus.cc:1217] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2] Dedup: 3.2->[]
I20260807 07:57:18.647696 30373 raft_consensus.cc:1275] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:18.647918 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:18.629990 30476 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:18.631595 32174 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:18.656639 32189 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:18.659252 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:18.660720 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.638681 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.666704 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.667233 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:18.668032 30373 raft_consensus.cc:2410] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:18.668524 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:18.667873 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:18.670321 30367 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:18.646519 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.672626 30579 raft_consensus.cc:1240] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 07:57:18.661615 30363 raft_consensus.cc:1240] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 07:57:18.675766 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.676091 30369 raft_consensus.cc:1240] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 07:57:18.684962 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.674243 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:18.709841 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:18.715873 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 73953.1us
I20260807 07:57:18.711902 30367 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:18.673285 32189 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:18.759127 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:18.782850 32340 log.cc:927] Time spent T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.064s user 0.001s sys 0.000s
I20260807 07:57:18.759151 30358 raft_consensus.cc:2393] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
W20260807 07:57:19.015100 30541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:19.023849 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 241050us
I20260807 07:57:18.783092 32300 consensus_queue.cc:1059] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260807 07:57:18.779322 32345 consensus_queue.cc:1059] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
W20260807 07:57:19.030064 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 270599us
I20260807 07:57:19.039830 30429 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:18.744347 32174 consensus_queue.cc:1059] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260807 07:57:18.748425 30480 raft_consensus.cc:1275] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:18.705655 32140 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
W20260807 07:57:19.053220 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:19.055763 30365 raft_consensus.cc:1275] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:19.069237 30365 raft_consensus.cc:1275] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260807 07:57:19.084408 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:19.144795 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 108830us
I20260807 07:57:19.130105 32226 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:19.137107 32140 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:19.148928 32300 raft_consensus.cc:3055] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:19.179388 30541 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:19.174139 32300 raft_consensus.cc:740] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:19.236462 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:19.237177 30490 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:19.156566 32345 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:19.245412 32337 consensus_queue.cc:1048] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260807 07:57:19.254216 32189 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:57:19.158077 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 119470us
I20260807 07:57:19.157567 32226 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.233270 32194 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260807 07:57:19.173923 32140 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.249768 32243 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:19.285970 32376 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:57:19.293877 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 254118us
I20260807 07:57:19.309772 32174 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:19.310353 32174 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.313745 32174 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:19.314221 32174 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:19.314673 32174 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.316488 32174 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:19.321884 32174 consensus_queue.cc:1059] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:19.289832 32189 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:19.331743 32189 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.287977 32376 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.335784 32376 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:19.336369 32376 raft_consensus.cc:3055] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:19.336705 32376 raft_consensus.cc:740] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:19.344552 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:19.345295 30489 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:19.348867 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:19.347666 32376 consensus_queue.cc:260] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.350821 32000 raft_consensus.cc:3055] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:19.351274 32000 raft_consensus.cc:740] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:19.352149 32000 consensus_queue.cc:260] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.350940 32376 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:19.355749 32355 log.cc:927] Time spent T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.215s user 0.001s sys 0.000s
I20260807 07:57:19.346920 30317 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:19.359911 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 180604us
W20260807 07:57:19.368898 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 130325us
I20260807 07:57:19.375941 30541 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.353279 32000 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:19.377804 30541 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.378666 32289 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:19.379240 32289 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.381579 32194 consensus_queue.cc:1059] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:19.383643 30541 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.384698 32289 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:19.349637 31385 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:19.363776 31966 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:19.404564 30323 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:19.391654 31966 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:19.400544 32345 raft_consensus.cc:697] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:19.416452 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 104558us
I20260807 07:57:19.419919 30365 raft_consensus.cc:1240] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:19.407183 32289 raft_consensus.cc:2804] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:19.422710 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:19.422767 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:19.425101 30365 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:19.407495 32385 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:19.409631 31966 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:19.411389 32387 raft_consensus.cc:2749] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 07:57:19.429587 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 46037.6us
I20260807 07:57:19.425482 32337 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:19.442911 32226 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:19.426610 32383 consensus_queue.cc:1048] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260807 07:57:19.429111 32377 consensus_queue.cc:1059] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260807 07:57:19.444442 32140 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:19.444633 32377 raft_consensus.cc:3055] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:19.444990 32377 raft_consensus.cc:740] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:19.445917 32377 consensus_queue.cc:260] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.446909 30429 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:19.447510 32377 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:19.447650 32174 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:19.448927 30429 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:19.434366 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:19.434799 32345 consensus_queue.cc:237] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.449649 32383 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:19.449690 30360 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:19.451050 32383 consensus_queue.cc:1048] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:19.428643 32243 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:19.439669 32353 log.cc:927] Time spent T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.313s user 0.001s sys 0.000s
I20260807 07:57:19.424505 32289 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:19.460461 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:19.462028 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:19.443359 32337 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.462652 30487 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:19.463742 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:19.463963 32337 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:19.455274 32289 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:19.459120 32000 consensus_queue.cc:1059] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260807 07:57:19.467321 32336 consensus_queue.cc:1059] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:19.468446 32368 raft_consensus.cc:3055] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:19.468806 32368 raft_consensus.cc:740] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:19.469691 31383 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:57:19.469566 32368 consensus_queue.cc:260] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.470800 32368 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:19.467526 30477 raft_consensus.cc:1240] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:19.461359 30429 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:19.472080 30317 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:19.474016 32410 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:19.474407 32410 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:19.474699 32410 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:19.479588 32387 consensus_queue.cc:1048] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:19.482234 32140 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:19.483502 31966 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.484489 30366 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:19.485044 32189 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:19.482103 32398 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:19.477728 30541 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.496217 31383 raft_consensus.cc:2955] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:19.497745 32300 consensus_queue.cc:260] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.499070 32300 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:19.495671 30429 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:19.506157 30541 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.490039 32398 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:19.487282 32345 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:19.511616 32345 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.513598 32345 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:19.509291 32398 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:19.515486 30429 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:19.526032 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:19.526661 30366 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:19.528469 30429 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:19.531622 30541 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.517094 32383 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:19.539144 30541 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.526805 32414 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:19.555358 30541 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.517885 32287 consensus_queue.cc:1059] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260807 07:57:19.560218 30541 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.532840 32390 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:19.532473 32345 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 07:57:19.557597 32342 log.cc:927] Time spent T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.312s user 0.003s sys 0.000s
I20260807 07:57:19.539907 32344 raft_consensus.cc:2749] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:19.554692 32403 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:19.562043 30541 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.554314 32400 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:19.581624 32400 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.583788 32400 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:19.556412 32243 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:19.557296 32383 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:19.584394 32383 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:19.558097 32254 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:19.556519 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:19.568300 30541 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.562856 32345 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:19.586345 32345 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:19.586169 30477 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:19.562877 32390 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:19.591660 32390 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:19.593194 32265 raft_consensus.cc:3055] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:19.593621 32265 raft_consensus.cc:740] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:19.594046 32383 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.594436 32265 consensus_queue.cc:260] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.595288 30488 raft_consensus.cc:1240] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 07:57:19.595805 32265 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:19.585691 32226 raft_consensus.cc:3055] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:19.599334 32226 raft_consensus.cc:740] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:19.599664 32289 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:19.603250 32339 log.cc:927] Time spent T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.549s user 0.003s sys 0.009s
I20260807 07:57:19.603879 30541 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.600234 32226 consensus_queue.cc:260] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.605588 32243 raft_consensus.cc:2749] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:19.605957 32226 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:19.607441 30541 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.563231 32194 raft_consensus.cc:2749] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:19.608817 32333 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:19.610097 32390 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.611091 32243 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:19.604791 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33928 (request call id 702) took 1032 ms. Trace:
I20260807 07:57:19.611558 32243 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.612111 30478 rpcz_store.cc:276] 0807 07:57:18.572879 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:18.573019 (+ 140us) service_pool.cc:224] Handling call
0807 07:57:18.573291 (+ 272us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:18.573928 (+ 637us) raft_consensus.cc:1534] Early marking committed up to index 3
0807 07:57:18.620060 (+ 46132us) log.cc:844] Serialized 14 byte log entry
0807 07:57:18.736532 (+116472us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:18.743399 (+ 6867us) log.cc:844] Serialized 26 byte log entry
0807 07:57:18.743609 (+ 210us) raft_consensus.cc:1645] Marking committed up to 3
0807 07:57:18.743667 (+ 58us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:18.743759 (+ 92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:19.602742 (+858983us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b440002250c. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b2116855 00007fd6b2117272 00007fd6b4ea13bb 00007fd6b4e9cc9f 00007fd6b4e90a5e 00007fd6b4e8fda6 00007fd6b4e8f9c8 00007fd6b4e99411 00007fd6b4e993c9 00007fd6b4e99359
0807 07:57:19.604545 (+ 1803us) raft_consensus.cc:1685] finished
0807 07:57:19.604624 (+ 79us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:19.604736 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1260,"raft.queue_time_us":1461,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":9058,"spinlock_wait_cycles":14244224,"thread_start_us":78062,"threads_started":1,"wal-append.queue_time_us":199018}
I20260807 07:57:19.613837 30541 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.603135 32406 raft_consensus.cc:2749] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:19.614673 32012 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:19.619755 32390 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:19.620308 32390 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:19.620729 32390 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.604669 32296 raft_consensus.cc:2749] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:19.616173 30541 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.633859 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:19.634425 30366 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:19.604568 32345 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.642985 30478 raft_consensus.cc:1240] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:19.631158 32243 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:19.678682 30430 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:19.634310 30541 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:19.706861 30539 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:57:19.713582 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 79345us
I20260807 07:57:19.707415 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:19.714658 30478 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:19.718297 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:19.719826 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:19.640239 32296 raft_consensus.cc:2749] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:19.600133 32398 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.629814 32403 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:19.722679 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:19.726698 30364 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:19.734548 30478 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:19.675257 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:19.712772 32406 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:19.722500 32344 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:19.644585 32415 consensus_queue.cc:1059] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260807 07:57:19.756831 30488 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:19.717005 32254 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:19.763018 30364 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:19.764077 30429 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:19.726776 32387 consensus_queue.cc:1059] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260807 07:57:19.755937 32390 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:19.762115 32344 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:19.785642 32415 raft_consensus.cc:3055] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:19.786249 32415 raft_consensus.cc:740] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:19.787696 32415 consensus_queue.cc:260] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:19.769704 32264 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:19.762589 32406 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.791285 32344 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:19.806648 32390 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:19.822731 32289 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:19.833309 32403 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:19.821552 32415 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:19.813109 32264 raft_consensus.cc:697] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:19.847266 32414 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 07:57:19.872234 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 157749us
I20260807 07:57:19.875049 32414 consensus_queue.cc:1048] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:19.881994 32012 consensus_queue.cc:1048] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:19.886787 30366 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
W20260807 07:57:19.887125 32427 log.cc:927] Time spent T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.104s user 0.001s sys 0.000s
I20260807 07:57:19.870342 32385 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:19.889040 32385 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.893510 30429 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:19.856515 32403 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.898667 32264 consensus_queue.cc:237] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.906582 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:19.908080 30487 raft_consensus.cc:2393] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:19.911500 32406 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:19.914608 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:19.915232 30478 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:19.916685 30539 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:19.916440 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:19.894627 32402 raft_consensus.cc:3055] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:19.917554 31383 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:19.917882 32402 raft_consensus.cc:740] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:19.918166 32289 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:19.918941 32289 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.919570 32383 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:19.921640 32398 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:19.925661 32406 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:19.926313 32406 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:19.928033 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:19.927081 32406 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:19.929262 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:19.932829 32403 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:19.935492 32368 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:19.850605 32390 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:19.929080 32289 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:19.928583 30366 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:19.936374 32368 raft_consensus.cc:697] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:19.942911 32385 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:19.998095 30366 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
W20260807 07:57:20.001843 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 127890us
I20260807 07:57:19.991210 32410 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:20.009783 32429 log.cc:927] Time spent T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.061s user 0.000s sys 0.001s
I20260807 07:57:20.006147 30429 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:20.015985 30590 pending_rounds.cc:85] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e: Aborting all ops after (but not including) 1
I20260807 07:57:20.023692 30590 pending_rounds.cc:107] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 07:57:20.024003 30590 raft_consensus.cc:2889] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:20.014930 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:20.009925 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 53082.8us
I20260807 07:57:20.017948 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.018599 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.016363 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.019560 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.028029 30586 raft_consensus.cc:2393] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:20.033517 30588 raft_consensus.cc:1275] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:20.035072 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.011021 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.015703 32410 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.040177 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.041802 30582 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:20.011572 32289 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:20.043521 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.045840 30585 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:20.034337 30358 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:20.048732 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:20.050238 30364 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:20.050794 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.051864 30429 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:20.040601 30584 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:20.053791 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:20.047036 32289 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:57:20.058045 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:20.059386 32289 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.039444 31383 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:20.052862 32377 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:20.069150 32428 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.069455 32385 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.071197 32428 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.063046 32390 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.074411 32428 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.071424 32385 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.076622 32385 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.077415 30581 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:20.079698 32254 raft_consensus.cc:2749] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:20.082484 32345 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.052660 32431 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.085728 32431 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:20.088505 32431 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.091235 30220 catalog_manager.cc:5697] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 2, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:20.061924 32383 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:20.109810 32383 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:20.110219 32383 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:20.114322 32377 raft_consensus.cc:697] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:20.115381 32377 consensus_queue.cc:237] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.028080 32368 consensus_queue.cc:237] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.107983 32344 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.041728 32402 consensus_queue.cc:260] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.134845 30220 catalog_manager.cc:5697] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 2 to 4, leader changed from <none> to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 4 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:20.136375 32344 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.137714 30223 catalog_manager.cc:5697] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 2 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:20.140851 32400 raft_consensus.cc:3055] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:20.141328 32400 raft_consensus.cc:740] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:20.103368 30360 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:20.108678 30323 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:20.109165 32433 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:20.069828 32417 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.146310 30588 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:20.150779 32433 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.143230 32400 consensus_queue.cc:260] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.113277 30584 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:20.152073 31849 raft_consensus.cc:2804] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:20.181107 30586 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:57:20.107343 32406 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.199849 32406 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.156692 32415 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.178505 32289 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:20.212450 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.212453 32421 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:20.192955 32433 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.205579 32400 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:20.152022 32417 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.214838 32226 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.205431 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.204203 32189 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:20.206249 32410 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.202616 31849 raft_consensus.cc:697] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:20.228911 32421 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.225260 30584 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:20.207146 32415 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.272929 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:20.218609 32289 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.216300 32140 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:20.265547 30429 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:20.252763 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.238672 32226 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.238725 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:20.267459 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.278775 30367 raft_consensus.cc:1240] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:20.278937 30590 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:20.280506 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:20.281898 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.282953 30585 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:20.271152 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.274797 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:20.283855 30365 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:20.286763 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:20.287357 30364 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:20.275910 32368 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260807 07:57:20.288197 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:20.289062 32140 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.291736 30581 raft_consensus.cc:2393] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:20.293526 30578 raft_consensus.cc:2393] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:20.297268 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:20.297969 30367 raft_consensus.cc:2393] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 5: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:20.298575 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:20.298902 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:20.299429 30369 raft_consensus.cc:2393] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:20.300335 30364 raft_consensus.cc:1240] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 07:57:20.299638 30360 raft_consensus.cc:2393] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
W20260807 07:57:20.279493 32436 log.cc:927] Time spent T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.088s user 0.003s sys 0.000s
I20260807 07:57:20.306834 30590 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:20.307432 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.307739 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.309051 32421 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.310472 32226 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.291893 32264 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:20.311805 32289 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.314162 31849 consensus_queue.cc:237] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:20.314905 32383 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.308233 30585 raft_consensus.cc:2393] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:20.307971 32140 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.330384 32265 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:20.331102 32265 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.327100 32243 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.334272 32243 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.335422 32383 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.325098 32406 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.338361 32406 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.342510 32417 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.276396 32410 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.274312 32189 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.305147 32390 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.334151 32264 raft_consensus.cc:697] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:20.348721 30366 raft_consensus.cc:2955] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:20.319664 32445 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:20.324344 32421 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:20.345201 32433 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.368134 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.368747 30590 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:20.369673 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.370198 30590 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:20.370977 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.349910 32344 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:20.350056 32415 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.354053 32012 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.378685 32403 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:20.385988 32419 log.cc:927] Time spent T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.661s user 0.005s sys 0.002s
I20260807 07:57:20.356992 32448 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.357333 32243 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.391561 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.346048 32425 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 07:57:20.402596 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.388391 31966 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.354864 32390 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.366787 32406 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.385988 32403 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.409847 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:20.414228 32264 consensus_queue.cc:237] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.416942 32410 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.417683 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:20.435750 30490 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:20.371927 32433 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.419306 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.420176 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.423985 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.438266 30581 raft_consensus.cc:2393] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:20.426344 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.438694 30578 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:20.428542 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.430810 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.439896 30482 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:20.365661 32421 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.424403 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.445922 30582 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:20.407138 32265 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.439462 30539 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:20.453349 30582 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:20.455308 30489 raft_consensus.cc:2393] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:20.456540 30541 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:20.456898 30429 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:20.458197 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.455435 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.459854 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.359584 32445 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.460655 30581 raft_consensus.cc:2393] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:20.389976 32012 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.460644 30582 raft_consensus.cc:2393] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:20.402853 32344 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.473915 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.477834 30578 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:20.488574 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.492218 30588 raft_consensus.cc:2393] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:20.464401 32265 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:20.473701 32394 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:20.504617 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 197922us
I20260807 07:57:20.502120 30541 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:20.406095 32448 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.507658 30320 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:20.488575 32194 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:20.509837 30541 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:20.514146 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:20.521538 30541 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:20.534986 30541 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:20.511344 32194 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:20.494011 32385 consensus_queue.cc:1059] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 07:57:20.536365 30578 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:20.509519 32243 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:20.510229 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:20.539124 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 66787.2us
I20260807 07:57:20.522471 32406 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:20.526598 32189 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:20.547078 32452 log.cc:927] Time spent T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260807 07:57:20.547726 32433 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.534123 32394 raft_consensus.cc:2749] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:20.550009 32296 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:20.582355 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.583745 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.584941 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:20.585981 32445 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.589993 32012 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.595371 32448 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.595993 30590 raft_consensus.cc:2410] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:20.596587 32344 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.597777 32421 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.561120 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.598904 30480 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
W20260807 07:57:20.599829 32454 log.cc:927] Time spent T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.162s user 0.001s sys 0.000s
I20260807 07:57:20.600627 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.605585 30490 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:20.543851 32194 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:20.613862 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.598896 32390 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.618000 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.619055 30490 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:20.610957 30480 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:20.622260 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.623313 30490 raft_consensus.cc:2410] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:20.618034 30487 raft_consensus.cc:2393] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:20.633261 32012 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:57:20.648969 32456 log.cc:927] Time spent T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.123s user 0.000s sys 0.001s
I20260807 07:57:20.660511 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.649711 32012 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.664927 32012 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.667310 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.668133 30477 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:20.669795 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.670446 30539 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:20.670490 30480 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:20.654762 32368 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:20.672652 32368 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.674628 32368 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.674942 32406 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:20.675364 32406 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:20.675752 32406 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:20.678483 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.653630 32394 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:20.679376 32394 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.675387 30578 raft_consensus.cc:1275] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 07:57:20.682159 30578 pending_rounds.cc:85] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e: Aborting all ops after (but not including) 1
I20260807 07:57:20.682381 30578 pending_rounds.cc:107] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 07:57:20.682621 30578 raft_consensus.cc:2889] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:20.682682 32383 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:20.683211 32383 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.685920 32383 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.687639 32394 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.690229 32403 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:20.679085 30480 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:20.693866 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.694558 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.694979 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.707579 30539 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:20.708680 30539 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:20.710609 32337 raft_consensus.cc:2804] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:20.711061 32337 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:20.711410 32337 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:20.714617 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:20.715272 30365 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:20.715567 32344 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:20.715972 32344 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:20.716295 32402 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:20.719010 32344 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:20.714700 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:20.727784 32140 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:20.727962 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.728648 30480 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:20.730583 31966 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 07:57:20.730780 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 223188us
I20260807 07:57:20.731899 30320 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:20.716176 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:20.732875 30365 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:20.733841 31966 raft_consensus.cc:2749] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:20.729102 30317 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:20.734760 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.734946 30317 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:20.735391 30488 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:20.735697 31966 raft_consensus.cc:2804] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:20.736075 31966 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:20.736390 31966 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:20.738371 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:20.736320 32425 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:20.738951 30478 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:20.739140 32425 raft_consensus.cc:697] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:20.728381 32140 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.740126 32425 consensus_queue.cc:237] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.741946 30317 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:20.742472 32140 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.743036 32410 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:20.743415 32410 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:20.743855 32410 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:20.747143 32289 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:20.747682 32289 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.748943 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:20.749542 30366 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:20.750037 30373 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:20.752195 31966 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.753165 30320 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:20.754011 32455 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:20.754345 30320 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:20.754026 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:20.758628 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.760308 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.743397 30317 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:20.754936 30373 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:20.773124 30317 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:20.773059 32415 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:20.775004 32415 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:20.775341 32140 raft_consensus.cc:2804] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:20.776098 32140 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:20.776726 32140 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:20.777645 30222 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53660 (request call id 184) took 3949 ms. Trace:
I20260807 07:57:20.775408 32415 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:20.785089 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 76476.2us
I20260807 07:57:20.789099 32226 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:20.795871 30372 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:20.798393 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.803195 32265 consensus_queue.cc:1048] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:20.782434 32455 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:20.806070 32455 raft_consensus.cc:697] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:20.807969 31966 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.807578 32455 consensus_queue.cc:237] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.811299 32410 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.813104 32406 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.815021 32410 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.816318 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.820763 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.781781 30317 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:20.781535 32289 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:20.797988 32390 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:20.823921 32289 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:20.775446 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.747699 30365 raft_consensus.cc:1275] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:20.786517 30539 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:20.826342 32428 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:20.826838 32428 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:20.827358 32428 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:20.831435 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:20.832038 30488 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:20.832020 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.837774 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:20.780187 30478 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:20.838353 30489 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:20.843885 30488 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:20.816625 30320 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:20.845726 30588 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:20.847436 30539 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:20.850433 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:20.852166 30585 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:20.824669 32289 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:20.854513 30320 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:20.858901 30429 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:57:20.783169 30222 rpcz_store.cc:276] 0807 07:57:16.828543 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:16.832567 (+ 4024us) service_pool.cc:224] Handling call
0807 07:57:20.777581 (+3945014us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:18.669611 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:18.676860 (+ 7249us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:18.678267 (+ 1407us) write_op.cc:435] Acquired schema lock
0807 07:57:18.680795 (+ 2528us) tablet.cc:662] Decoding operations
0807 07:57:18.758458 (+ 77663us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:18.760687 (+ 2229us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:18.779676 (+ 18989us) tablet.cc:685] Acquiring locks for 2 operations
0807 07:57:18.882445 (+102769us) tablet.cc:701] Row locks acquired
0807 07:57:18.882466 (+ 21us) write_op.cc:260] PREPARE: finished
0807 07:57:19.035070 (+152604us) write_op.cc:270] Start()
0807 07:57:19.035201 (+ 131us) write_op.cc:276] Timestamp: P: 1786089439035000 usec, L: 0
0807 07:57:19.035216 (+ 15us) op_driver.cc:348] REPLICATION: starting
0807 07:57:19.035840 (+ 624us) log.cc:844] Serialized 928 byte log entry
0807 07:57:19.260610 (+224770us) op_driver.cc:464] REPLICATION: finished
0807 07:57:19.441469 (+180859us) write_op.cc:301] APPLY: starting
0807 07:57:19.441571 (+ 102us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:19.441686 (+ 115us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:19.441834 (+ 148us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:19.442264 (+ 430us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:19.442429 (+ 165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 07:57:19.442468 (+ 39us) write_op.cc:312] APPLY: finished
0807 07:57:19.442665 (+ 197us) log.cc:844] Serialized 28 byte log entry
0807 07:57:19.455533 (+ 12868us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:19.461682 (+ 6149us) write_op.cc:454] Released schema lock
0807 07:57:19.472900 (+ 11218us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:19.517787 (+ 44887us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:19.527444 (+ 9657us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":128010,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":180575,"apply.run_cpu_time_us":2088,"apply.run_wall_time_us":51870,"num_ops":2,"prepare.queue_time_us":6862,"prepare.run_cpu_time_us":10832,"prepare.run_wall_time_us":368244,"replication_time_us":225216,"thread_start_us":163946,"threads_started":1}]]}
I20260807 07:57:20.868583 30317 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:20.870882 30320 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:20.877243 30320 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:20.858351 32289 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:20.858785 32410 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:20.901537 32410 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:20.902043 32410 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:20.863571 32421 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.875140 32012 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:20.881587 32445 raft_consensus.cc:2804] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:20.881801 32448 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:20.892401 32300 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:20.898504 32345 raft_consensus.cc:2764] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260807 07:57:20.898115 32417 raft_consensus.cc:2804] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:20.954200 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.964159 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.894572 32460 raft_consensus.cc:2804] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:20.864966 32344 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.965161 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.979827 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.971032 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.974126 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.900600 32453 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.070s
I20260807 07:57:20.955588 31966 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:20.987349 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.914238 32337 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.025008 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:21.025779 30578 raft_consensus.cc:2368] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:21.025228 30586 raft_consensus.cc:2393] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 4: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:21.026577 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.967073 32012 raft_consensus.cc:697] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:21.028519 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:20.979540 30579 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:20.979948 32390 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:21.031159 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.920269 32421 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.971894 32460 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:20.985204 32417 raft_consensus.cc:697] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:21.039883 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:21.093618 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:21.094226 30587 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:21.095057 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:21.032296 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:20.972608 32445 raft_consensus.cc:697] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:21.092145 30585 raft_consensus.cc:2393] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:20.969497 32300 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:20.986662 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:21.108891 32415 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.111825 32300 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:21.115140 32445 consensus_queue.cc:237] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.120465 31383 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260807 07:57:21.122243 32194 consensus_meta.cc:287] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.502s user 0.009s sys 0.002s
I20260807 07:57:21.122661 32194 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.131036 32415 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:21.091709 32460 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:21.040745 32345 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:21.161701 32140 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.026084 31966 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.098448 32391 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:57:21.105979 32270 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4: Append to log took a long time: real 0.068s user 0.001s sys 0.000s
W20260807 07:57:21.131109 32471 log.cc:927] Time spent T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.099s user 0.000s sys 0.000s
I20260807 07:57:21.197562 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:21.198177 30479 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:21.201859 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:21.087455 32390 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.218887 30489 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:21.187855 32194 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.208657 32368 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:21.164810 32410 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.280658 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:21.233570 30584 raft_consensus.cc:2393] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:21.220556 32403 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:21.222764 32433 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:21.171938 32415 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
I20260807 07:57:21.231033 32417 consensus_queue.cc:237] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.292474 31966 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:21.187390 32345 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.322865 30317 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:21.293503 32432 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:57:21.306524 32477 log.cc:927] Time spent T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.203s user 0.000s sys 0.001s
I20260807 07:57:21.324983 30489 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:21.328316 32140 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:21.328531 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:21.328920 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:21.414757 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:21.329475 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:21.385897 31966 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:21.193146 32391 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:21.331000 32468 log.cc:927] Time spent T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.359s user 0.000s sys 0.002s
I20260807 07:57:21.331249 32344 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.335852 32421 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:21.336741 30579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34604 (request call id 679) took 1181 ms. Trace:
I20260807 07:57:21.339166 32337 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.303434 32433 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.219466 32012 consensus_queue.cc:237] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.298620 32403 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.439033 32433 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.439489 32403 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:21.386618 30429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s user 0.000s sys 0.016s
I20260807 07:57:21.288134 32368 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.440727 32406 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.443070 32368 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:21.409693 30479 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:21.415235 30488 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:21.329843 32410 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:21.383581 32432 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.420324 30476 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:21.426550 31966 raft_consensus.cc:697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:21.425268 32140 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260807 07:57:21.386955 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 47725us
W20260807 07:57:21.445492 30429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s user 0.000s sys 0.029s
I20260807 07:57:21.422451 30579 rpcz_store.cc:276] 0807 07:57:20.155186 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:20.176671 (+ 21485us) service_pool.cc:224] Handling call
0807 07:57:21.336546 (+1159875us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b54001de554. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:21.336651 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1687248768}
I20260807 07:57:21.457826 30581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 903) took 1089 ms. Trace:
W20260807 07:57:21.454183 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 571447us
I20260807 07:57:21.462836 30488 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:21.465301 30317 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:21.466845 32410 raft_consensus.cc:2804] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:21.467545 32410 raft_consensus.cc:697] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:21.468472 32410 consensus_queue.cc:237] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.468806 32406 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:21.470494 30490 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:21.469491 32406 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.474507 31966 consensus_queue.cc:237] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.476652 32432 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:21.477545 32345 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:21.478752 32391 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:21.496519 32390 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:21.461560 30581 rpcz_store.cc:276] 0807 07:57:20.368523 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:20.461422 (+ 92899us) service_pool.cc:224] Handling call
0807 07:57:20.461719 (+ 297us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:20.462137 (+ 418us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:20.462164 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:20.466465 (+ 4301us) log.cc:844] Serialized 26 byte log entry
0807 07:57:20.639938 (+173473us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:20.639982 (+ 44us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:20.640054 (+ 72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:21.457646 (+817592us) raft_consensus.cc:1685] finished
0807 07:57:21.457667 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:21.457775 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13336,"raft.queue_time_us":91,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":10232,"thread_start_us":137766,"threads_started":1,"wal-append.queue_time_us":390780}
I20260807 07:57:21.491106 30317 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:21.485304 32428 consensus_meta.cc:287] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.657s user 0.010s sys 0.001s
W20260807 07:57:21.503669 32289 consensus_meta.cc:287] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.596s user 0.009s sys 0.002s
I20260807 07:57:21.519276 30429 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:21.505937 32455 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:21.526130 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.525496 30429 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:57:21.526394 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.529294 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.529510 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:21.530092 30367 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:21.530813 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.531039 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:21.532536 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.533288 30366 raft_consensus.cc:2393] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:21.542882 30429 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:21.544639 32482 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:21.542219 32432 raft_consensus.cc:2804] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:21.551674 32432 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:21.552611 32432 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:21.553171 32333 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:21.554076 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.555548 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:21.524902 32393 raft_consensus.cc:2764] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260807 07:57:21.565894 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.566602 32368 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:21.569038 32495 log.cc:927] Time spent T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.152s user 0.001s sys 0.000s
I20260807 07:57:21.529675 32455 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:21.578799 32455 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:21.560372 32337 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:21.525128 32289 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.574926 30488 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:21.575168 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:21.582729 30372 raft_consensus.cc:2393] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:21.576658 30367 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:21.578066 30429 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:57:21.519495 32428 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.591276 32428 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.591020 32337 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.592574 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:21.558146 32333 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.562315 32410 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:21.581284 32345 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260807 07:57:21.594538 32410 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:21.576082 30320 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:21.599663 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:21.583812 32417 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:21.600572 32445 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:21.570729 32460 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.605257 30478 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:57:21.623008 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.624104 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.627311 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.603998 30320 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:21.629690 30320 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:21.631294 30320 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:21.638239 32421 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:21.639801 32421 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:21.640784 32448 raft_consensus.cc:2749] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:21.603457 32333 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.610885 32345 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:21.641870 32406 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.622166 30539 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:21.627956 32393 consensus_queue.cc:1048] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260807 07:57:21.581159 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.649371 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.650596 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:21.651121 30364 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:21.652192 32410 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.654124 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.654740 30373 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:21.655517 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:21.656126 30487 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:21.656540 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:21.661425 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:21.661671 30360 raft_consensus.cc:1240] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:21.664337 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.660442 30320 leader_election.cc:400] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
I20260807 07:57:21.666885 30320 leader_election.cc:403] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 07:57:21.667693 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:21.668061 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.668663 30360 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:21.669497 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.669701 30479 raft_consensus.cc:2393] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:21.670073 30360 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:21.670903 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.671504 30360 raft_consensus.cc:2393] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:21.619477 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.664902 30365 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:21.660408 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:21.677670 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:21.678268 30478 raft_consensus.cc:2393] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:21.679225 30320 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:21.683791 30320 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:21.685063 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.687319 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.688634 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:21.688004 30367 raft_consensus.cc:2393] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:21.689254 30587 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
W20260807 07:57:21.672915 32376 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s user 0.012s sys 0.022s
I20260807 07:57:21.669641 32445 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:21.694883 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:21.699713 30586 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:21.699997 30360 raft_consensus.cc:1240] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:21.697072 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:21.696352 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 74273.6us
I20260807 07:57:21.677368 32345 raft_consensus.cc:697] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:21.706422 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:21.723421 30488 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:21.680224 32189 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3.
W20260807 07:57:21.694414 32376 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s user 0.012s sys 0.022s
I20260807 07:57:21.719983 30541 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:21.706103 30539 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:21.722173 30364 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:21.737140 30541 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:21.737931 30373 raft_consensus.cc:1240] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:21.726526 30320 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:21.692724 31849 raft_consensus.cc:2749] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:21.684667 32402 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:21.691751 32333 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:21.660816 32417 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.685500 32410 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260807 07:57:21.698443 32390 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:21.698998 32406 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:21.705705 31966 raft_consensus.cc:2749] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:21.740572 32194 raft_consensus.cc:2749] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:21.751318 30320 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:21.752923 30541 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:21.753979 32406 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.720921 32394 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:21.742626 32428 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:21.743024 32445 raft_consensus.cc:2749] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:21.764148 32345 consensus_queue.cc:237] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.765537 32448 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:21.749433 32333 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:21.766618 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:21.792477 30579 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:21.767655 32385 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:21.793145 32385 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.768632 32337 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.774895 32243 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:21.778308 30541 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:21.779897 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:21.802243 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.803454 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:21.803932 30373 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:21.746928 32433 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:21.729269 32480 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 07:57:21.784544 32406 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.786026 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:21.794970 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.830385 30360 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:21.756270 32417 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:21.826438 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 48215us
I20260807 07:57:21.835683 32385 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.837065 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:21.838032 30487 raft_consensus.cc:2393] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 2: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:21.844900 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.846058 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.777745 32394 raft_consensus.cc:697] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:21.847064 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:21.847846 30541 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:21.857721 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:21.858361 30586 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:21.859566 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:21.747351 32402 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.794234 32448 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:21.755466 32390 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:21.809016 32433 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:21.849473 32337 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:21.884790 30578 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:21.886653 30541 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:21.747023 32488 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.120s
I20260807 07:57:21.872676 30358 raft_consensus.cc:2410] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:21.895304 30541 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:21.897830 30541 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:21.901515 30429 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:21.876420 32448 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:21.884827 32433 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:21.945533 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:21.946398 30490 raft_consensus.cc:2410] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:21.847743 32394 consensus_queue.cc:237] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.906628 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:21.900112 32243 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:21.899883 32194 raft_consensus.cc:2749] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:21.907863 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:21.911974 30317 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:21.916129 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:21.918430 32368 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:21.919178 30429 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:21.920429 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:21.901997 32385 raft_consensus.cc:2749] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:21.924764 32333 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.926407 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:21.926201 32455 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:21.898342 32406 raft_consensus.cc:2749] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:21.960541 30429 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:21.934022 32432 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:21.937636 32473 log.cc:927] Time spent T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
I20260807 07:57:21.943186 32402 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:21.962788 32289 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:21.954396 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:57:21.958465 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 46565us
I20260807 07:57:21.963073 30490 raft_consensus.cc:1275] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:21.927009 32460 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:21.962529 32500 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:21.962103 30487 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:21.957767 32368 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 07:57:21.951804 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 48474.6us
I20260807 07:57:22.018850 30541 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:21.965077 32529 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:22.010809 30360 raft_consensus.cc:2368] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:21.988811 30373 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:22.026758 32194 consensus_queue.cc:1059] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:22.028328 32333 raft_consensus.cc:3055] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:21.997151 32383 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:22.033128 30541 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:22.012043 32500 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:22.021903 32368 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:22.028245 32194 raft_consensus.cc:2749] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:22.022429 32529 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:22.028751 32333 raft_consensus.cc:740] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:22.038480 30541 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:22.051692 30490 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:22.055302 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:22.056463 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:22.039170 32428 raft_consensus.cc:2749] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:22.058028 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:22.034066 32383 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:22.034787 32406 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:22.063616 30541 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:22.066668 32243 raft_consensus.cc:2749] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:22.068289 32406 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.071661 32428 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:22.072453 32428 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.075453 32406 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:22.076418 32428 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:22.041074 32500 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:22.083267 30541 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:22.084981 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:22.041577 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:22.113502 30541 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:22.111099 30223 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40988 (request call id 39) took 4144 ms. Trace:
W20260807 07:57:22.114277 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 122944us
I20260807 07:57:22.107887 32337 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:22.047257 32529 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:22.113874 30317 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:22.084982 32383 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:22.127404 30541 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:22.139853 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:22.140542 30372 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:22.141243 30320 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:22.151253 30320 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:22.152666 30320 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:22.141788 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:22.155001 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:22.114892 30223 rpcz_store.cc:276] 0807 07:57:17.966335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:17.966479 (+ 144us) service_pool.cc:224] Handling call
0807 07:57:22.111033 (+4144554us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:20.338752 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:20.339685 (+ 933us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:20.339740 (+ 55us) write_op.cc:435] Acquired schema lock
0807 07:57:20.339783 (+ 43us) tablet.cc:662] Decoding operations
0807 07:57:20.340385 (+ 602us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:20.340441 (+ 56us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:20.340504 (+ 63us) tablet.cc:685] Acquiring locks for 1 operations
0807 07:57:20.340863 (+ 359us) tablet.cc:701] Row locks acquired
0807 07:57:20.340882 (+ 19us) write_op.cc:260] PREPARE: finished
0807 07:57:20.341111 (+ 229us) write_op.cc:270] Start()
0807 07:57:20.341270 (+ 159us) write_op.cc:276] Timestamp: P: 1786089440341018 usec, L: 0
0807 07:57:20.341315 (+ 45us) op_driver.cc:348] REPLICATION: starting
0807 07:57:20.428500 (+ 87185us) log.cc:844] Serialized 598 byte log entry
0807 07:57:20.671996 (+243496us) op_driver.cc:464] REPLICATION: finished
0807 07:57:21.020937 (+348941us) write_op.cc:301] APPLY: starting
0807 07:57:21.521730 (+500793us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b60001c01c8. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b8c7fb41 00007fd6b8df008b 00007fd6b8df26b4 00007fd6b8d630bb 00007fd6b8c60573 00007fd6b8c627c8 00007fd6b8d61814 00007fd6b8d4d35c 00007fd6b8d51741 00007fd6b8d516f9 00007fd6b8d51689
0807 07:57:21.524773 (+ 3043us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:21.543172 (+ 18399us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:21.554338 (+ 11166us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:21.576645 (+ 22307us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:21.583180 (+ 6535us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 07:57:21.583289 (+ 109us) write_op.cc:312] APPLY: finished
0807 07:57:21.585501 (+ 2212us) log.cc:844] Serialized 22 byte log entry
0807 07:57:21.585808 (+ 307us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:21.585908 (+ 100us) write_op.cc:454] Released schema lock
0807 07:57:21.585980 (+ 72us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:21.586565 (+ 585us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:21.586623 (+ 58us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":196,"mutex_wait_us":634103,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":300410,"apply.run_cpu_time_us":47808,"apply.run_wall_time_us":599196,"num_ops":1,"prepare.queue_time_us":195109,"prepare.run_cpu_time_us":4435,"prepare.run_wall_time_us":99200,"replication_time_us":315406,"spinlock_wait_cycles":4199296,"thread_start_us":297032,"threads_started":1}]]}
I20260807 07:57:22.142158 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:22.158439 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 44644.8us
I20260807 07:57:22.118552 32428 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:22.123425 30579 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:22.166800 30590 raft_consensus.cc:2955] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:22.155525 32243 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:22.191601 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:22.185802 30364 raft_consensus.cc:1240] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:22.178166 30480 raft_consensus.cc:1275] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:22.162288 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:22.112709 32189 consensus_queue.cc:1048] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260807 07:57:22.155329 31849 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:22.161800 32490 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:22.161532 32410 raft_consensus.cc:2749] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:22.170059 32403 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:22.168023 32460 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:22.163149 32337 raft_consensus.cc:697] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:22.173352 32421 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260807 07:57:22.224838 32460 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:22.235821 32490 raft_consensus.cc:697] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:22.237612 32490 consensus_queue.cc:237] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.154268 32542 consensus_queue.cc:1059] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
W20260807 07:57:22.219430 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 54114.4us
I20260807 07:57:22.198630 32243 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:22.235705 32460 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:22.220396 32432 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:22.175727 32543 consensus_queue.cc:1059] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260807 07:57:22.214659 32455 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:22.270282 32539 raft_consensus.cc:3055] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:22.270877 32539 raft_consensus.cc:740] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:22.280308 32455 consensus_queue.cc:1048] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260807 07:57:22.282522 32536 log.cc:927] Time spent T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.275s user 0.002s sys 0.000s
I20260807 07:57:22.285596 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:22.286219 30479 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:22.248764 32243 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:22.246690 32289 raft_consensus.cc:2749] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 07:57:22.270474 32537 log.cc:927] Time spent T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.103s user 0.000s sys 0.001s
I20260807 07:57:22.299858 30479 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:22.238590 32403 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.196790 32333 consensus_queue.cc:260] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:22.300287 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 99998.5us
I20260807 07:57:22.322943 30478 raft_consensus.cc:1240] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:22.343503 30429 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:22.346776 30478 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:22.351051 32433 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.355923 30588 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:22.272317 32539 consensus_queue.cc:260] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.435775 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:22.435149 32344 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:22.439880 32552 log.cc:927] Time spent T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.099s user 0.000s sys 0.000s
I20260807 07:57:22.439527 32344 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.441823 32563 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:22.442714 32563 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.456539 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:22.457850 32344 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:22.462852 32563 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:22.463804 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:22.464231 32529 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.467180 32500 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.470113 32433 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:22.472420 32403 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:22.436530 30581 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:22.533356 30581 raft_consensus.cc:1275] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:22.537294 30358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45054 (request call id 817) took 1003 ms. Trace:
I20260807 07:57:22.538086 30358 rpcz_store.cc:276] 0807 07:57:21.534024 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:21.560086 (+ 26062us) service_pool.cc:224] Handling call
0807 07:57:22.533281 (+973195us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54001432d4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:22.537187 (+ 3906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241790336}
I20260807 07:57:22.544034 32333 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:22.476547 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:22.547185 30478 raft_consensus.cc:2368] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
W20260807 07:57:22.548276 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 53989.3us
I20260807 07:57:22.549461 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:22.537369 30581 raft_consensus.cc:1275] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 07:57:22.313231 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 160643us
I20260807 07:57:22.496325 32539 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:22.498749 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:22.554438 30587 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:22.493611 32406 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:22.499997 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:22.501355 30584 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 07:57:22.546204 32552 log.cc:927] Time spent T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.105s user 0.003s sys 0.000s
I20260807 07:57:22.506172 30588 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:22.504917 32368 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.508036 32390 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:22.430964 32337 consensus_queue.cc:237] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:22.508889 32448 consensus_meta.cc:287] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.571s user 0.003s sys 0.011s
I20260807 07:57:22.514325 32529 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:22.524358 30582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34604 (request call id 693) took 1570 ms. Trace:
I20260807 07:57:22.525540 30578 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:57:22.552971 30320 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:22.551266 30317 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:22.573650 30373 raft_consensus.cc:2410] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:22.579618 30582 rpcz_store.cc:276] 0807 07:57:20.953837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:20.953930 (+ 93us) service_pool.cc:224] Handling call
0807 07:57:22.524165 (+1570235us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b5400200dd4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:22.524297 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1785307008}
I20260807 07:57:22.586681 30585 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 07:57:22.589445 30541 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.64.129:36407 timed out after 1.989s (SENT) [suppressed 60 similar messages]
I20260807 07:57:22.598470 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:22.598634 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:22.603737 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:22.604480 30363 raft_consensus.cc:2393] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:22.609097 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:22.587182 32289 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:22.566783 32406 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:22.616247 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 241059us
I20260807 07:57:22.617105 30429 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:22.583226 32448 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.625854 30478 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:22.627460 32529 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:22.636078 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:22.637804 30588 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:22.627941 32529 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:22.667363 30541 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:22.620217 32568 raft_consensus.cc:2804] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:22.671562 30588 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
W20260807 07:57:22.680603 32383 consensus_meta.cc:287] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818: Time spent flushing consensus metadata: real 0.512s user 0.009s sys 0.000s
I20260807 07:57:22.677539 32394 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:22.681836 32394 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:22.682299 32394 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:22.666540 32529 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:22.692101 32448 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:22.689018 30579 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:22.703135 32406 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:22.703662 32460 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:22.704458 32500 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:22.707453 32460 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:22.712144 30429 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:22.713012 30585 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:22.713698 32482 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:22.714392 32482 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:22.715013 32482 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:22.713059 30429 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:22.720239 30539 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:22.735576 32289 raft_consensus.cc:697] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:22.736178 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:22.743060 30539 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:22.746071 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:22.746812 30363 raft_consensus.cc:2393] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:22.748519 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:22.749047 30363 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:22.749642 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:22.750422 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:22.751070 30587 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:22.752673 30488 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:22.755280 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:22.755889 30367 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:22.763020 30369 raft_consensus.cc:1240] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3. Ops: []
W20260807 07:57:22.765673 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 146111us
I20260807 07:57:22.768127 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:22.769079 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:22.769994 30367 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:22.681232 32383 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.729092 32390 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:22.789450 30539 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:22.791538 30539 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:22.762538 32563 raft_consensus.cc:2749] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:22.800374 30488 raft_consensus.cc:2368] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5.
I20260807 07:57:22.758147 32494 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:22.790150 32368 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:22.826365 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:22.790685 32390 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:22.796131 32403 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:22.834354 30587 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
W20260807 07:57:22.834837 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 44210.8us
I20260807 07:57:22.836918 30581 raft_consensus.cc:1240] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:22.737731 32289 consensus_queue.cc:237] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:22.825737 32402 raft_consensus.cc:2749] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:22.802047 32558 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:22.836645 32390 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:22.833003 32559 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
W20260807 07:57:22.908752 32591 log.cc:927] Time spent T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.068s user 0.001s sys 0.000s
I20260807 07:57:22.909070 32543 raft_consensus.cc:3055] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:22.930274 30317 leader_election.cc:400] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5.
I20260807 07:57:22.930593 30317 leader_election.cc:403] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260807 07:57:22.934270 30429 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:22.936631 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:22.941336 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:22.932523 32543 raft_consensus.cc:740] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:22.921893 32265 consensus_queue.cc:1059] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260807 07:57:22.948331 32243 consensus_meta.cc:287] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.621s user 0.007s sys 0.007s
I20260807 07:57:22.942647 32393 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:22.976662 32265 raft_consensus.cc:3055] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
W20260807 07:57:22.988240 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 196776us
I20260807 07:57:22.989918 30539 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:22.991783 30539 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:22.949030 32604 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:22.938232 32368 consensus_queue.cc:1059] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260807 07:57:22.987622 32265 raft_consensus.cc:740] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:22.962617 32383 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:23.003006 30539 leader_election.cc:400] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:23.004087 30539 leader_election.cc:403] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 07:57:23.005085 30539 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:23.006589 30363 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:22.994192 32402 consensus_queue.cc:1059] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260807 07:57:22.997690 32428 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260807 07:57:23.014037 32265 consensus_queue.cc:260] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.015985 32385 raft_consensus.cc:2749] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:23.004583 32403 raft_consensus.cc:2749] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:22.989101 32243 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.032618 30360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45054 (request call id 844) took 1181 ms. Trace:
I20260807 07:57:23.036018 30360 rpcz_store.cc:276] 0807 07:57:21.846450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:21.846855 (+ 405us) service_pool.cc:224] Handling call
0807 07:57:23.027885 (+1181030us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54003c00d4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:23.028002 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":374952832}
I20260807 07:57:23.001097 32393 raft_consensus.cc:697] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:23.019134 32494 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
W20260807 07:57:23.037240 32607 log.cc:927] Time spent T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.075s user 0.000s sys 0.002s
I20260807 07:57:23.050879 30578 raft_consensus.cc:2393] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 5: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:23.043565 32012 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260807 07:57:23.073501 32465 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:23.127303 32333 consensus_meta.cc:287] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.582s user 0.005s sys 0.010s
I20260807 07:57:23.090780 32390 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:23.151674 32610 log.cc:927] Time spent T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.092s user 0.000s sys 0.001s
I20260807 07:57:23.158041 30429 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:23.163440 32489 raft_consensus.cc:2749] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 07:57:23.068864 32393 consensus_queue.cc:237] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.186645 30489 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:23.143590 32508 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:23.188323 30429 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:23.205173 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:23.187417 32243 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:23.185726 32140 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:23.227979 30429 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:23.229622 32140 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.243633 31849 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:23.248328 32622 log.cc:927] Time spent T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.090s user 0.000s sys 0.000s
I20260807 07:57:23.248147 31849 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.249667 31383 consensus_queue.cc:237] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:23.230145 32604 raft_consensus.cc:2749] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5.
W20260807 07:57:23.256162 32482 consensus_meta.cc:287] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818: Time spent flushing consensus metadata: real 0.540s user 0.012s sys 0.001s
I20260807 07:57:23.243695 32333 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:23.214542 32508 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:23.255930 32445 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:23.236747 32529 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.254562 30480 raft_consensus.cc:2955] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:57:23.318032 32536 log.cc:927] Time spent T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.053s user 0.003s sys 0.000s
I20260807 07:57:23.330507 30478 raft_consensus.cc:1240] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:23.306234 32140 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:23.324249 32394 consensus_meta.cc:287] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.636s user 0.012s sys 0.005s
I20260807 07:57:23.302496 32482 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:23.309355 32333 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.350850 30489 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:23.355803 32576 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:23.356662 32576 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.314961 32445 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.368839 32265 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:23.357615 32617 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:23.391158 31849 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:23.391968 32445 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:23.342196 32390 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:23.396885 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34358 (request call id 68) took 1336 ms. Trace:
I20260807 07:57:23.400452 30476 rpcz_store.cc:276] 0807 07:57:22.060786 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:22.062476 (+ 1690us) service_pool.cc:224] Handling call
0807 07:57:23.396189 (+1333713us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b5800091898. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b83d2 00007fd6bb124219 00007fd6ba277640 00007fd6ba33febb 00007fd6ba33ff41 00007fd6ba301dd0 00007fd6ba2ec739 00007fd6ba2ec1e2 00007fd6b3831d34
0807 07:57:23.396404 (+ 215us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:23.396587 (+ 183us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:23.396611 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:23.396651 (+ 40us) raft_consensus.cc:1645] Marking committed up to 5
0807 07:57:23.396677 (+ 26us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:23.396731 (+ 54us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:23.396829 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30098688}
I20260807 07:57:23.398933 32333 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:23.348966 32394 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
W20260807 07:57:23.410177 31339 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:23.394997 32482 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:23.404211 32617 raft_consensus.cc:697] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:23.422962 32543 consensus_queue.cc:260] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:23.432307 32627 log.cc:927] Time spent T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.090s user 0.001s sys 0.000s
I20260807 07:57:23.433841 32529 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:23.439725 30586 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
W20260807 07:57:23.440949 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:23.435631 32617 consensus_queue.cc:237] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.501904 32576 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:23.507285 32394 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:23.510702 30373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45054 (request call id 846) took 1371 ms. Trace:
I20260807 07:57:23.511112 30373 rpcz_store.cc:276] 0807 07:57:22.139749 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:22.141469 (+ 1720us) service_pool.cc:224] Handling call
0807 07:57:23.510506 (+1369037us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b5400352ad4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:23.510643 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950258432}
I20260807 07:57:23.512318 32568 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:23.551728 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:23.552508 30578 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 4.
I20260807 07:57:23.520936 32333 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:23.564515 32561 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:23.565025 32561 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:23.550729 32289 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s user 0.016s sys 0.044s
I20260807 07:57:23.580385 30581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 951) took 1274 ms. Trace:
I20260807 07:57:23.549827 32568 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:23.580983 30581 rpcz_store.cc:276] 0807 07:57:22.306215 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:22.565658 (+259443us) service_pool.cc:224] Handling call
0807 07:57:22.570764 (+ 5106us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:22.837451 (+266687us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:23.580124 (+742673us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400238a54. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:23.580324 (+ 200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611599104}
I20260807 07:57:23.584322 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33916 (request call id 952) took 1266 ms. Trace:
I20260807 07:57:23.584705 30479 rpcz_store.cc:276] 0807 07:57:22.318411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:22.318919 (+ 508us) service_pool.cc:224] Handling call
0807 07:57:23.583634 (+1264715us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b5800091898. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b83d2 00007fd6bb124219 00007fd6ba277640 00007fd6ba33febb 00007fd6ba33ff41 00007fd6ba301dd0 00007fd6ba2ec739 00007fd6ba2ec1e2 00007fd6b3831d34
0807 07:57:23.583839 (+ 205us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:23.584017 (+ 178us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:23.584042 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:23.584081 (+ 39us) raft_consensus.cc:1645] Marking committed up to 2
0807 07:57:23.584108 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:23.584160 (+ 52us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:23.584265 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9052032}
I20260807 07:57:23.554924 32508 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:23.587841 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:23.589131 30581 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
W20260807 07:57:23.583391 32289 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s user 0.016s sys 0.044s
I20260807 07:57:23.560356 32333 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.613020 30581 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:23.621788 32626 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:23.622354 32626 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.624692 32626 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:23.636629 30578 raft_consensus.cc:1275] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:57:23.672246 32333 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:23.683653 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:23.685855 30578 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:23.687143 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:23.687860 30581 raft_consensus.cc:2368] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5.
I20260807 07:57:23.690251 32630 consensus_queue.cc:1048] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260807 07:57:23.699589 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:23.700088 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:23.702677 32140 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:23.703572 32140 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.705674 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:23.706147 32417 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:23.706928 32417 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:23.689217 32637 log.cc:927] Time spent T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
W20260807 07:57:23.712803 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 270729us
I20260807 07:57:23.712815 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:23.713580 30317 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:23.716854 30541 leader_election.cc:400] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:23.717181 30541 leader_election.cc:403] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:57:23.721299 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:23.722056 30490 raft_consensus.cc:2393] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:23.721922 32626 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:23.714556 32558 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:23.732352 30541 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:23.769340 32601 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:23.721577 32410 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:23.735703 32626 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:23.730770 32558 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:23.712620 32445 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:23.753427 32561 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:23.709923 31849 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:23.857131 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 129984us
W20260807 07:57:23.860222 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:23.859916 32406 raft_consensus.cc:2749] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:23.859947 32417 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:23.863101 30578 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:23.861930 30220 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53640 (request call id 173) took 4386 ms. Trace:
W20260807 07:57:23.871924 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 158407us
W20260807 07:57:23.861562 32641 log.cc:927] Time spent T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.189s user 0.001s sys 0.009s
I20260807 07:57:23.875840 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:23.878108 30487 raft_consensus.cc:1275] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:57:24.017959 30365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45046 (request call id 1002) took 2304 ms. Trace:
I20260807 07:57:24.094667 30220 rpcz_store.cc:276] 0807 07:57:19.469730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:19.470271 (+ 541us) service_pool.cc:224] Handling call
0807 07:57:23.856452 (+4386181us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:20.245872 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:20.286522 (+ 40650us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:20.286594 (+ 72us) write_op.cc:435] Acquired schema lock
0807 07:57:20.286643 (+ 49us) tablet.cc:662] Decoding operations
0807 07:57:20.287641 (+ 998us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:20.287725 (+ 84us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:20.287812 (+ 87us) tablet.cc:685] Acquiring locks for 2 operations
0807 07:57:20.288243 (+ 431us) tablet.cc:701] Row locks acquired
0807 07:57:20.288258 (+ 15us) write_op.cc:260] PREPARE: finished
0807 07:57:20.288487 (+ 229us) write_op.cc:270] Start()
0807 07:57:20.288695 (+ 208us) write_op.cc:276] Timestamp: P: 1786089440288441 usec, L: 0
0807 07:57:20.288717 (+ 22us) op_driver.cc:348] REPLICATION: starting
0807 07:57:20.337974 (+ 49257us) log.cc:844] Serialized 986 byte log entry
0807 07:57:20.509994 (+172020us) op_driver.cc:464] REPLICATION: finished
0807 07:57:20.839320 (+329326us) write_op.cc:301] APPLY: starting
0807 07:57:20.839502 (+ 182us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:20.839711 (+ 209us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:20.863367 (+ 23656us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:20.900474 (+ 37107us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:20.951880 (+ 51406us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 07:57:20.966558 (+ 14678us) write_op.cc:312] APPLY: finished
0807 07:57:20.989713 (+ 23155us) log.cc:844] Serialized 28 byte log entry
0807 07:57:21.024745 (+ 35032us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:21.033399 (+ 8654us) write_op.cc:454] Released schema lock
0807 07:57:21.038479 (+ 5080us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:21.161730 (+123251us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:21.161819 (+ 89us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1090782,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":319715,"apply.run_cpu_time_us":3791,"apply.run_wall_time_us":264824,"num_ops":2,"prepare.queue_time_us":102793,"prepare.run_cpu_time_us":7528,"prepare.run_wall_time_us":92547,"replication_time_us":206676,"thread_start_us":185498,"threads_started":2}]]}
I20260807 07:57:23.874490 32377 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:24.088809 30365 rpcz_store.cc:276] 0807 07:57:21.615728 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:21.678599 (+ 62871us) service_pool.cc:224] Handling call
0807 07:57:22.535739 (+857140us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:22.535946 (+ 207us) raft_consensus.cc:1534] Early marking committed up to index 2
0807 07:57:22.536305 (+ 359us) log.cc:844] Serialized 14 byte log entry
0807 07:57:22.799098 (+262793us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:22.799153 (+ 55us) raft_consensus.cc:1645] Marking committed up to 2
0807 07:57:22.799194 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:22.800989 (+ 1795us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:23.364832 (+563843us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b180028b220. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb10bf31 00007fd6bb1186d1 00007fd6b21bdc56 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb10bf31 00007fd6bb1186d1 00007fd6b21efd33 00007fd6b21f2121
0807 07:57:23.415251 (+ 50419us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b180028b220. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb10bf31 00007fd6bb1186d1 00007fd6b21efd33 00007fd6b21f2121 00007fd6b21f20d9 00007fd6b21f2069 00007fd6b21f2031 00007fd6b21f132d 00000000003aa554 00000000003aa399 00007fd6b21d31ea
0807 07:57:23.919559 (+504308us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54001432d0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f5c8d 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:23.919696 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":659,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":14224,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":24933,"spinlock_wait_cycles":1978914176,"thread_start_us":262396,"threads_started":2,"wal-append.queue_time_us":102686}
I20260807 07:57:24.163172 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:23.930027 32403 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:23.884400 32604 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:23.910724 32647 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:24.016824 32406 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.053160 32428 raft_consensus.cc:3055] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:23.881641 32394 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:23.914208 32140 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:23.873914 32626 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:23.874187 32410 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.175228 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33928 (request call id 803) took 1324 ms. Trace:
I20260807 07:57:24.125041 32189 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:23.880774 32445 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.180764 30365 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:24.181213 30478 rpcz_store.cc:276] 0807 07:57:22.851305 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:22.851416 (+ 111us) service_pool.cc:224] Handling call
0807 07:57:22.851680 (+ 264us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:23.334537 (+482857us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:24.175002 (+840465us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b540012be54. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:24.175174 (+ 172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100725632}
I20260807 07:57:24.185516 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:24.182368 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.131441 32460 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:23.884979 31849 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.139012 32650 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:24.183681 30367 raft_consensus.cc:1275] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:24.171729 32561 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.187136 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:24.171484 32012 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.186803 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.196571 30369 raft_consensus.cc:2393] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 5: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:24.189733 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:24.173856 32428 raft_consensus.cc:740] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:24.174819 32604 raft_consensus.cc:697] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:24.177726 32589 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.160979 32377 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:24.204344 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:24.204799 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.207734 30367 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:24.210724 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:24.212033 32140 consensus_queue.cc:1048] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:24.214875 32465 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.231976 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:24.238554 30365 raft_consensus.cc:2393] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:24.233502 30476 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:24.233165 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:24.226877 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:24.240233 30369 raft_consensus.cc:2368] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:24.235342 32654 consensus_queue.cc:1059] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260807 07:57:23.881038 32601 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.219013 30373 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:24.176192 32406 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.180540 32558 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:24.207659 32662 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:24.206863 32568 consensus_meta.cc:287] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818: Time spent flushing consensus metadata: real 0.618s user 0.008s sys 0.009s
I20260807 07:57:24.250756 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:24.254324 30478 raft_consensus.cc:2368] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:24.205672 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:24.190003 32189 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.248948 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.183790 32647 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.255738 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.267271 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.178916 32403 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:24.180037 32394 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:24.235996 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 319019us
I20260807 07:57:24.257989 32570 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:24.197700 32460 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.289357 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.232101 32589 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.284134 32511 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:24.284724 32189 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.285998 30358 raft_consensus.cc:2410] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260807 07:57:24.286574 30586 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34604 (request call id 721) took 2451 ms (client timeout 1690 ms). Trace:
W20260807 07:57:24.296411 30586 rpcz_store.cc:269] 0807 07:57:21.835401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:21.870720 (+ 35319us) service_pool.cc:224] Handling call
0807 07:57:22.825234 (+954514us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800003998. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b83d2 00007fd6bb124219 00007fd6ba277640 00007fd6ba33febb 00007fd6ba33ff41 00007fd6ba2edeb0 00007fd6ba2ed794 00007fd6b3836834 00007fd6b38367c2
0807 07:57:24.286334 (+1461100us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400238554. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:24.286436 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404696320}
I20260807 07:57:24.286734 32385 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.206326 32012 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.203461 32561 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.263377 32660 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:24.294473 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:24.256188 32490 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:24.268985 32417 raft_consensus.cc:3055] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:24.267788 32563 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.199482 32650 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.309149 32647 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.294826 30490 raft_consensus.cc:1240] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:23.914628 32559 raft_consensus.cc:2955] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:24.262818 32568 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:24.315960 30429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.050s user 0.024s sys 0.022s
I20260807 07:57:24.304457 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.262176 32428 consensus_queue.cc:260] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:24.322722 30429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.057s user 0.025s sys 0.022s
W20260807 07:57:24.327116 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 1.06379e+06us
I20260807 07:57:24.302785 32570 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.330078 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:24.330698 30585 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:24.331939 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:24.332526 30590 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:24.339396 30590 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:24.341321 30588 raft_consensus.cc:1240] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:24.304554 32385 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.317058 32417 raft_consensus.cc:740] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:24.246037 32465 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.322914 32406 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.359040 30585 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:24.361018 32385 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.354175 30489 raft_consensus.cc:1240] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:24.288017 32662 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.359084 32465 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.364265 32662 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.354871 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:24.372260 32445 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.305125 32511 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.355647 32601 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.355736 32376 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:24.356088 32417 consensus_queue.cc:260] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:24.378185 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 160547us
W20260807 07:57:24.377987 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 167528us
I20260807 07:57:24.386243 30429 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:24.329593 32377 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.391460 30320 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:24.346274 32494 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.344830 32647 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:24.321290 32563 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.320159 32490 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.352273 32428 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:24.354908 32642 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.316462 32604 consensus_queue.cc:237] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:24.458020 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 56255us
I20260807 07:57:24.352547 32432 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:24.378180 32626 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.382936 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:24.464764 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 69452.9us
I20260807 07:57:24.474665 30320 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:24.474819 32394 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.394985 32576 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:24.394917 32445 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:24.400707 31849 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.473286 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.478964 32417 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:24.502559 30584 raft_consensus.cc:2368] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3.
I20260807 07:57:24.313158 32660 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.475994 30539 leader_election.cc:400] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:24.511279 30539 leader_election.cc:403] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 07:57:24.479652 32377 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:24.480930 32650 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.394714 32601 consensus_queue.cc:1048] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260807 07:57:24.458038 32662 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:24.465205 32189 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.491715 32490 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.463876 32494 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.383873 32608 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:57:24.392066 32376 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.468977 32653 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.428532 32558 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260807 07:57:24.523902 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.475905 32655 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:24.491648 32568 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.467725 32647 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.527856 31849 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260807 07:57:24.478683 32432 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.470393 32654 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260807 07:57:24.487303 32561 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.506170 32460 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.520130 32289 raft_consensus.cc:2749] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:24.566103 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.595916 32511 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.596269 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.587484 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:24.597424 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.598490 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.599455 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.600364 32494 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.600770 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.601393 32563 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.524145 32012 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.602422 30579 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:24.604197 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:24.549127 32189 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.605185 30579 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:24.612743 32189 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.543406 32666 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:24.528883 32377 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.589105 32570 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.589046 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.487795 32642 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.594357 32432 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.546980 32662 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.623697 32376 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.518921 32576 raft_consensus.cc:697] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:24.546725 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:24.563583 32653 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.630533 32403 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:24.563051 32589 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.583544 32655 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.583230 32608 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:24.641175 32660 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.643222 32647 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.677549 32674 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:24.717085 32642 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.718705 32662 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.719449 32576 consensus_queue.cc:237] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.721005 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:24.723100 32377 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.705715 32673 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:24.731148 32674 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:24.747277 32608 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:24.750487 32655 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.759246 32674 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.735140 32673 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.767318 32673 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:24.768188 32653 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:24.839924 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 372747us
I20260807 07:57:24.848978 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:24.613765 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.867054 30477 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:24.869542 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.871225 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.872627 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.904503 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.905875 30490 raft_consensus.cc:2410] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 07:57:24.914619 30490 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 07:57:24.915570 30490 pending_rounds.cc:85] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818: Aborting all ops after (but not including) 1
I20260807 07:57:24.916333 30490 pending_rounds.cc:107] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 07:57:24.917250 30490 raft_consensus.cc:2889] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:24.929509 30584 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
W20260807 07:57:24.942119 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 436878us
I20260807 07:57:24.960391 31336 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:24.961622 31966 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.962800 31966 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.969408 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:24.973344 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:24.986475 32289 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:57:24.987098 32368 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:24.987542 32289 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:24.988097 32368 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.989766 32376 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:24.990532 32376 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.992071 32377 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:24.992923 32377 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.995289 32460 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.995687 32511 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:24.995755 32542 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:24.996672 32511 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:24.996960 32542 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:25.028573 32511 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:24.989202 32333 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:25.040560 32674 consensus_queue.cc:1048] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260807 07:57:25.041803 32460 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.042421 32368 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.043342 32688 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 07:57:25.047585 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 78286.3us
I20260807 07:57:25.056422 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:25.055644 31385 raft_consensus.cc:2955] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:25.065534 32333 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.066706 32460 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:25.068207 32690 log.cc:927] Time spent T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.257s user 0.001s sys 0.000s
I20260807 07:57:25.068693 32333 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:25.057191 31966 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.070436 32368 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:25.054023 32289 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:25.073499 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.074482 30363 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:25.078116 31336 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:25.080812 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:25.071121 32368 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.100714 32488 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:25.101886 32368 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.101666 32488 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.092936 30579 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:25.100605 32543 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:25.105201 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 128066us
I20260807 07:57:25.106693 32674 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 07:57:25.115322 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 79860.8us
W20260807 07:57:25.117527 30541 leader_election.cc:336] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): Timed out: RequestConsensusVote RPC to 127.27.64.129:36407 timed out after 1.989s (SENT)
W20260807 07:57:25.108283 32648 log.cc:927] Time spent T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 1.175s user 0.019s sys 0.012s
I20260807 07:57:25.130242 30541 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:25.134045 32488 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.134893 30476 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:25.135783 32432 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:25.136330 32432 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.137543 30320 leader_election.cc:400] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5.
I20260807 07:57:25.140604 31966 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:25.141525 31966 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.143218 30480 raft_consensus.cc:2955] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:25.139140 30320 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:25.151310 32460 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:25.143868 31966 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.152571 30320 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:25.164703 30582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42218 (request call id 81) took 1470 ms. Trace:
I20260807 07:57:25.165215 30582 rpcz_store.cc:276] 0807 07:57:23.694055 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:23.695296 (+ 1241us) service_pool.cc:224] Handling call
0807 07:57:23.695769 (+ 473us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:23.696041 (+ 272us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:23.696055 (+ 14us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:23.696587 (+ 532us) log.cc:844] Serialized 501 byte log entry
0807 07:57:23.862743 (+166156us) raft_consensus.cc:1645] Marking committed up to 4
0807 07:57:23.862785 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:23.862855 (+ 70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:25.084701 (+1221846us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b440002250c. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b2116855 00007fd6b2117272 00007fd6b4ea13bb 00007fd6b4e9cc9f 00007fd6b4e90a5e 00007fd6b4e8fda6 00007fd6b4e8f9c8 00007fd6b4e99411 00007fd6b4e993c9 00007fd6b4e99359
0807 07:57:25.164120 (+ 79419us) raft_consensus.cc:1685] finished
0807 07:57:25.164141 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:25.164459 (+ 318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31946496,"thread_start_us":165891,"threads_started":1,"wal-append.queue_time_us":173689}
I20260807 07:57:25.168522 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.171406 32243 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:25.171787 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:25.173460 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.176649 30578 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:25.173898 32460 raft_consensus.cc:2749] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:25.178679 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:25.179764 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 66877.1us
I20260807 07:57:25.180076 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.137492 32289 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260807 07:57:25.182564 30320 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:25.183511 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:25.184000 30363 raft_consensus.cc:1240] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:25.184603 30373 raft_consensus.cc:2393] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:25.187279 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.188079 30582 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:25.189983 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.184767 30478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:25.191799 30478 raft_consensus.cc:606] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:25.193022 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.194198 30487 raft_consensus.cc:3055] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:25.198537 30487 raft_consensus.cc:740] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:25.198838 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33928 (request call id 815) took 1024 ms. Trace:
I20260807 07:57:25.199579 30487 consensus_queue.cc:260] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.200753 30487 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:25.199198 30479 rpcz_store.cc:276] 0807 07:57:24.174446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:24.174560 (+ 114us) service_pool.cc:224] Handling call
0807 07:57:24.175123 (+ 563us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:24.253514 (+ 78391us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:24.253553 (+ 39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:24.253592 (+ 39us) raft_consensus.cc:1645] Marking committed up to 2
0807 07:57:24.253622 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:25.198296 (+944674us) spinlock_profiling.cc:243] Waited 78.2 ms on lock 0x7b54001c9dd4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:25.198369 (+ 73us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:25.198586 (+ 217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179810176}
I20260807 07:57:25.201318 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:25.214381 32432 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.216467 30372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45054 (request call id 868) took 1027 ms. Trace:
I20260807 07:57:25.174185 30586 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:25.219020 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.219830 30476 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:25.181332 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:25.194137 30482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33916 (request call id 938) took 3535 ms (client timeout 3175 ms). Trace:
I20260807 07:57:25.221820 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:25.221637 30482 rpcz_store.cc:269] 0807 07:57:21.658969 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:21.660185 (+ 1216us) service_pool.cc:224] Handling call
0807 07:57:25.193707 (+3533522us) spinlock_profiling.cc:243] Waited 2.56 s on lock 0x7b5400175554. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:25.193926 (+ 219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5883695872}
I20260807 07:57:25.216820 30372 rpcz_store.cc:276] 0807 07:57:24.188544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:24.188670 (+ 126us) service_pool.cc:224] Handling call
0807 07:57:24.188916 (+ 246us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:24.263937 (+ 75021us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:24.263965 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:24.264006 (+ 41us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:24.264034 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:25.216054 (+952020us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b54003aedd4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:25.216112 (+ 58us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:25.216295 (+ 183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172144512}
I20260807 07:57:25.227829 32377 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.232012 32410 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.237223 32433 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:25.238127 32433 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.240612 32433 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:25.140762 32198 raft_consensus.cc:2955] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:25.240783 32344 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:25.241595 32344 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.242480 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.243777 32344 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:25.255914 32189 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:25.256721 32189 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.266108 30487 raft_consensus.cc:1275] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260807 07:57:25.266502 30487 pending_rounds.cc:85] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818: Aborting all ops after (but not including) 1
I20260807 07:57:25.266743 30487 pending_rounds.cc:107] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260807 07:57:25.266983 30487 raft_consensus.cc:2889] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:25.276906 30366 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:25.238220 32542 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:25.292412 32189 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.293128 30489 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33928 (request call id 822) took 1058 ms. Trace:
I20260807 07:57:25.293599 30489 rpcz_store.cc:276] 0807 07:57:24.199627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:24.203591 (+ 3964us) service_pool.cc:224] Handling call
0807 07:57:24.203843 (+ 252us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:24.362002 (+158159us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:25.257237 (+895235us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400145354. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:25.257540 (+ 303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345277312}
I20260807 07:57:25.294718 32500 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:25.295521 32500 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.299160 30366 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:25.300076 30369 raft_consensus.cc:1275] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:25.301940 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.302793 30367 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:25.302908 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:25.301260 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.304088 32289 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:25.307552 30429 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:25.256100 32376 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.309900 32376 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:25.310498 32376 raft_consensus.cc:697] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:25.311739 32376 consensus_queue.cc:237] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.314978 30360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45054 (request call id 867) took 1126 ms. Trace:
I20260807 07:57:25.315393 30360 rpcz_store.cc:276] 0807 07:57:24.188245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:24.189108 (+ 863us) service_pool.cc:224] Handling call
0807 07:57:24.189344 (+ 236us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:24.202592 (+ 13248us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:24.202620 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:24.202657 (+ 37us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:24.202683 (+ 26us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:25.314527 (+1111844us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b54003aeb54. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:25.314590 (+ 63us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:25.314774 (+ 184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30093696}
W20260807 07:57:25.324929 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 142480us
I20260807 07:57:25.325883 30320 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:25.327623 32460 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:25.332690 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.336838 30221 catalog_manager.cc:5697] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 2, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 2 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:25.340452 30487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33916 (request call id 982) took 1093 ms. Trace:
I20260807 07:57:25.345566 30487 rpcz_store.cc:276] 0807 07:57:24.247470 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:24.905866 (+658396us) service_pool.cc:224] Handling call
0807 07:57:25.193858 (+287992us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:25.267436 (+ 73578us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:25.340170 (+ 72734us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400175550. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f5c8d 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:25.340360 (+ 190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661196672}
I20260807 07:57:25.358387 32500 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.362743 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:25.364410 30590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 980) took 1022 ms. Trace:
I20260807 07:57:25.366315 30487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:25.366899 30487 raft_consensus.cc:606] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:57:25.367229 30487 raft_consensus.cc:614] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 07:57:25.368186 30488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33916 (request call id 969) took 2040 ms. Trace:
W20260807 07:57:25.369602 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 121026us
I20260807 07:57:25.370785 30539 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:25.371670 32243 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:25.372049 32243 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260807 07:57:25.372273 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:25.373003 32377 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:25.373574 32377 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.375700 32377 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.376482 32140 consensus_queue.cc:1059] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:25.377504 32140 raft_consensus.cc:3055] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:25.377946 32140 raft_consensus.cc:740] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:25.379195 32140 consensus_queue.cc:260] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.381403 32140 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:25.364835 30590 rpcz_store.cc:276] 0807 07:57:24.341553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:24.352091 (+ 10538us) service_pool.cc:224] Handling call
0807 07:57:24.352346 (+ 255us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:24.362460 (+ 10114us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:24.362491 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:24.362531 (+ 40us) raft_consensus.cc:1645] Marking committed up to 3
0807 07:57:24.362561 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:25.363988 (+1001427us) spinlock_profiling.cc:243] Waited 9.9 ms on lock 0x7b54000bd1d4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:25.364058 (+ 70us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:25.364238 (+ 180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22778112}
I20260807 07:57:25.383181 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.321291 30223 catalog_manager.cc:5697] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 1 to 4, now has a pending config: VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129), VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130), VOTER f831a53ec51d452398015797d543164e (127.27.64.131), VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 4 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:25.386518 30476 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:25.384016 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.386627 30487 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:25.387073 30477 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:25.384738 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.387713 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.388334 30487 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:25.389513 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.368582 30488 rpcz_store.cc:276] 0807 07:57:23.327684 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:24.426067 (+1098383us) service_pool.cc:224] Handling call
0807 07:57:25.367151 (+941084us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b5800091898. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b83d2 00007fd6bb124219 00007fd6ba277640 00007fd6ba33febb 00007fd6ba33ff41 00007fd6ba301dd0 00007fd6ba2ec739 00007fd6ba2ec1e2 00007fd6b3831d34
0807 07:57:25.367446 (+ 295us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:57:25.367719 (+ 273us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:25.367748 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:57:25.367809 (+ 61us) raft_consensus.cc:1645] Marking committed up to 4
0807 07:57:25.367836 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:25.367894 (+ 58us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:25.367998 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8590720}
I20260807 07:57:25.385437 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.372370 32243 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:57:25.405361 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 42f1efe3594f411d9ed19ae2875c1bf0 (from ef1ca7acf52a438f89f14707e9e06818 to f831a53ec51d452398015797d543164e) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:25.409600 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.416312 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.417296 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.418900 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.421931 30372 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:25.424482 30478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f2551f38a348389729e12d49142027"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:25.430534 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.432065 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.440752 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.441713 30429 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:25.444355 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.445369 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.446100 30373 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:25.446772 32402 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:25.449330 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.450156 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.451581 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.449657 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.452445 30358 raft_consensus.cc:2393] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:25.452577 30372 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:25.453722 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.454378 30360 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:25.455348 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.455986 30373 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:25.456806 32243 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.454044 30539 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:25.461827 32542 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:25.462363 32402 raft_consensus.cc:2804] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:25.462852 32402 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:25.463301 32402 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:25.463702 32542 raft_consensus.cc:697] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:25.464143 30429 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:25.464895 32542 consensus_queue.cc:237] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:25.461694 32243 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:25.468852 30539 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:25.440865 30478 raft_consensus.cc:606] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:25.472465 30478 raft_consensus.cc:614] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 07:57:25.476984 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet c8f2551f38a348389729e12d49142027 (from ef1ca7acf52a438f89f14707e9e06818 to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:25.479688 32243 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:25.482357 30369 raft_consensus.cc:1275] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:25.482743 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.484979 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.480712 32243 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:25.491947 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.491930 32243 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:25.501796 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.502558 30590 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:25.503208 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.506469 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.507674 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.508906 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.510146 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.510723 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.511406 30579 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:25.512615 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.513309 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.514434 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.513624 32243 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.515628 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.510226 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.517087 30587 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:25.519117 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.520186 30587 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:25.533327 32344 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:25.530790 30429 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:25.532078 30539 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:25.534950 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.534708 32344 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.535883 30317 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:25.540164 32490 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:25.540475 30317 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:25.541770 30317 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:25.541847 32680 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:25.542356 32669 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:25.542778 32669 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:25.543174 32669 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:25.544301 32243 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:25.545706 32417 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 07:57:25.546066 32714 log.cc:927] Time spent T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.064s user 0.000s sys 0.001s
I20260807 07:57:25.546365 32671 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:25.546089 32417 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:25.547806 32417 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:25.548578 32490 consensus_queue.cc:1048] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:25.542353 32680 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:25.549943 32680 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:25.541294 32344 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:25.549544 30579 raft_consensus.cc:1275] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:25.554036 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.554749 30579 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:25.556902 30317 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:25.557694 32500 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:25.582863 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:25.583526 30590 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 4.
I20260807 07:57:25.580371 32542 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:25.627601 32198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35160 (request call id 0) took 2471 ms. Trace:
I20260807 07:57:25.628108 32198 rpcz_store.cc:276] 0807 07:57:23.201561 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:23.221521 (+ 19960us) service_pool.cc:224] Handling call
0807 07:57:23.308565 (+ 87044us) log.cc:844] Serialized 501 byte log entry
0807 07:57:25.586449 (+2277884us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":259,"raft.queue_time_us":24452,"raft.run_cpu_time_us":944,"raft.run_wall_time_us":944,"thread_start_us":291365,"threads_started":1,"wal-append.queue_time_us":321207,"wal-append.run_cpu_time_us":33384,"wal-append.run_wall_time_us":1584941}
I20260807 07:57:25.629799 32402 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.630514 30205 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6acbd1341f44b138a96457c583930e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:57:25.632203 32402 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:25.634382 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 103675us
I20260807 07:57:25.644017 32680 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.628216 32417 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.668550 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:25.668049 32505 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260807 07:57:25.676470 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:25.677074 30490 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:25.677727 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.679522 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.677666 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.682180 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:25.659812 32542 consensus_queue.cc:1048] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260807 07:57:25.699928 30482 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:25.701918 30429 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:25.682281 32669 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.714709 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:25.718799 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:25.721520 30579 raft_consensus.cc:2955] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:25.722867 32680 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.710585 32140 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:25.731160 30490 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:25.709780 32673 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:25.732344 30360 raft_consensus.cc:1240] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:25.747802 30539 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:25.751600 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.752563 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.755026 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.756877 30429 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:25.742409 32671 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:25.760421 30429 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:25.767510 30429 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:25.757923 32243 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:25.749946 32140 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.771960 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.774268 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.774078 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.792356 30487 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:25.811314 30480 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:25.766407 32368 raft_consensus.cc:2804] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:25.815634 30541 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:25.817732 30487 raft_consensus.cc:1240] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:25.820433 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.822466 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.823354 30429 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:25.775792 32543 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:25.774089 32243 raft_consensus.cc:697] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:25.826745 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.767637 32402 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260807 07:57:25.826258 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:57:25.828840 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 81132.8us
I20260807 07:57:25.830009 30429 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:25.814954 32368 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:25.797473 32490 consensus_queue.cc:1048] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260807 07:57:25.773332 32671 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.775274 32673 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.842808 32140 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.840651 32542 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:25.844323 32680 consensus_queue.cc:1059] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:25.845158 32243 consensus_queue.cc:237] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.846087 32402 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:57:25.846611 32376 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:25.847175 32300 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:25.881563 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.847479 30429 leader_election.cc:400] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3.
I20260807 07:57:25.847719 32480 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:25.849469 32482 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:25.846222 32543 consensus_queue.cc:1048] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260807 07:57:25.883523 32300 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.883883 32480 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.885784 32300 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.885926 32480 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.883391 32482 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:25.886659 32482 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:25.853955 32669 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.852238 32417 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.834775 32377 raft_consensus.cc:2804] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:25.891422 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:25.837736 32368 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:25.882642 30429 leader_election.cc:403] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260807 07:57:25.883131 32345 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:25.858325 32542 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:25.902319 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.901024 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.903689 30373 raft_consensus.cc:2393] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
W20260807 07:57:25.909066 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 69914.4us
I20260807 07:57:25.910887 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.917793 32542 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:25.925930 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 78597.8us
I20260807 07:57:25.929467 32505 raft_consensus.cc:2749] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3.
I20260807 07:57:25.883177 32376 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:25.931470 32376 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.897184 32377 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:25.933084 32377 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:25.933187 32727 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260807 07:57:25.938459 32673 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:25.938962 32542 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:25.941785 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 93893.6us
I20260807 07:57:25.940770 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:25.943596 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 114115us
I20260807 07:57:25.956434 32542 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.958405 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.961530 30488 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 1.
I20260807 07:57:25.971411 30541 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:25.972438 30539 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:25.974586 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:25.995144 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:25.993695 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 67059.5us
I20260807 07:57:25.997346 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:25.999730 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:26.003190 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 49956.4us
I20260807 07:57:26.014420 30482 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:26.017604 32671 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:25.993217 32673 raft_consensus.cc:2804] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:26.021754 32673 raft_consensus.cc:697] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:26.022691 32673 consensus_queue.cc:237] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.025581 32344 raft_consensus.cc:2749] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 07:57:26.030172 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 49547.6us
I20260807 07:57:26.031499 30539 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:26.039366 30429 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:26.041356 32542 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:26.041817 32542 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:26.041869 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:26.042356 32542 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.043910 30539 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:26.048221 30541 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.054582 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:26.054971 32377 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.064730 32482 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.077580 30541 leader_election.cc:400] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 2. Current term is 3.
I20260807 07:57:26.077450 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:26.078709 30541 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.079876 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:26.081789 32740 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:26.082516 32740 raft_consensus.cc:2804] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:26.082862 32740 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:26.083185 32740 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.081076 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:26.099485 30476 raft_consensus.cc:2393] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 3: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:26.110859 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:26.111680 30365 raft_consensus.cc:2393] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:26.114671 32368 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.118677 32368 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:26.090901 32490 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:26.101543 32377 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:26.124271 32460 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:26.124500 32500 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:26.125106 32500 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.126262 32460 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.127337 32500 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:26.075901 32748 raft_consensus.cc:2804] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:26.131367 30487 raft_consensus.cc:1240] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:26.128417 30429 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:26.127898 32345 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:26.131253 32460 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:26.134377 32735 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:26.136916 32490 raft_consensus.cc:697] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:26.140043 32490 consensus_queue.cc:237] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.124819 32671 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:26.146782 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 68182.3us
I20260807 07:57:26.132601 32748 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:26.127823 32542 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.136548 32345 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.150976 32751 consensus_queue.cc:1059] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:26.153545 32671 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.157800 32744 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:26.161875 32482 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:26.149593 32748 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:26.170909 32671 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:26.171550 32673 raft_consensus.cc:3055] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:26.171927 32673 raft_consensus.cc:740] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:26.172685 32673 consensus_queue.cc:260] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.173853 32673 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.174700 32542 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:26.138948 32735 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.178961 32735 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:26.180322 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:26.181006 30488 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:26.182459 30539 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:26.183164 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:26.183449 32402 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:26.183920 32402 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:26.184242 32402 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.180999 30429 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:26.192143 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:26.194438 30489 raft_consensus.cc:1240] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:26.197093 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:26.200827 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:26.179842 32740 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.197986 32140 raft_consensus.cc:3055] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:26.223428 30480 raft_consensus.cc:2393] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 2: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:26.236593 32542 raft_consensus.cc:2804] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:26.237222 32542 raft_consensus.cc:697] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:26.238195 32542 consensus_queue.cc:237] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.241816 32728 consensus_queue.cc:1059] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:26.243065 32680 raft_consensus.cc:3055] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:26.243454 32680 raft_consensus.cc:740] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:26.244307 32680 consensus_queue.cc:260] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.175511 32345 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.250113 30478 raft_consensus.cc:1240] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:26.234020 32140 raft_consensus.cc:740] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:26.252604 30489 raft_consensus.cc:1240] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:26.252252 32140 consensus_queue.cc:260] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.254644 32140 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:26.251264 30429 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
W20260807 07:57:26.262826 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:26.249123 32748 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.280508 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:26.281131 30478 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:26.276944 32402 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.287278 32402 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:26.288820 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:26.290051 30489 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.293437 30478 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:26.294718 30539 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:26.295222 30579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:26.295912 32345 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:26.300745 30489 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
W20260807 07:57:26.301893 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 50968.1us
I20260807 07:57:26.269730 32543 raft_consensus.cc:2764] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260807 07:57:26.295856 30579 raft_consensus.cc:606] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.311112 30539 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:26.312085 306 raft_consensus.cc:2804] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:26.312358 32727 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:26.312666 306 raft_consensus.cc:697] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:26.289979 32748 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:26.297549 32735 consensus_queue.cc:1059] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260807 07:57:26.321010 32759 log.cc:927] Time spent T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.099s user 0.001s sys 0.000s
I20260807 07:57:26.318513 30429 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:26.309085 30579 raft_consensus.cc:614] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 07:57:26.302539 32763 consensus_queue.cc:1059] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260807 07:57:26.328346 32680 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.329156 32740 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:26.330698 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:26.331626 306 consensus_queue.cc:237] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.325956 32376 raft_consensus.cc:2764] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260807 07:57:26.337347 30489 raft_consensus.cc:1240] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:26.345434 32727 raft_consensus.cc:697] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
W20260807 07:57:26.351567 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet f16f3d2817a34261bb25577fa0f9e2de (from f831a53ec51d452398015797d543164e to ef1ca7acf52a438f89f14707e9e06818) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:26.352178 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:26.354038 32727 consensus_queue.cc:237] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.354571 30480 raft_consensus.cc:1240] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:26.356611 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:26.355525 305 consensus_queue.cc:1059] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260807 07:57:26.365449 32417 consensus_queue.cc:1059] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260807 07:57:26.341501 302 raft_consensus.cc:3055] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:26.372969 302 raft_consensus.cc:740] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:26.367713 30477 raft_consensus.cc:606] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:26.372151 30223 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40988 (request call id 40) took 3863 ms. Trace:
I20260807 07:57:26.372501 32417 raft_consensus.cc:3055] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Stepping down as leader of term 3
W20260807 07:57:26.374507 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 50353.4us
I20260807 07:57:26.376108 30541 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.379493 30429 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:26.375180 32417 raft_consensus.cc:740] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:26.380151 32376 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260807 07:57:26.380865 32417 consensus_queue.cc:260] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.382072 32417 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:26.385816 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:26.388962 32482 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:26.390564 30541 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.389693 32482 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:26.396473 32482 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.387789 32490 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:26.399981 30541 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.398227 32735 raft_consensus.cc:2749] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:26.414717 32734 consensus_queue.cc:1059] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:26.415877 32376 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:26.416105 32761 raft_consensus.cc:3055] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:26.416567 32761 raft_consensus.cc:740] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:26.417533 32761 consensus_queue.cc:260] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.418025 302 consensus_queue.cc:260] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.418746 32761 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:26.416517 32376 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.427587 32376 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:26.374365 30223 rpcz_store.cc:276] 0807 07:57:22.508899 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:22.509071 (+ 172us) service_pool.cc:224] Handling call
0807 07:57:26.372068 (+3862997us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:25.470651 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:25.479597 (+ 8946us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:25.480797 (+ 1200us) write_op.cc:435] Acquired schema lock
0807 07:57:25.480811 (+ 14us) tablet.cc:662] Decoding operations
0807 07:57:25.530445 (+ 49634us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:25.534041 (+ 3596us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:25.539021 (+ 4980us) tablet.cc:685] Acquiring locks for 1 operations
0807 07:57:25.539297 (+ 276us) tablet.cc:701] Row locks acquired
0807 07:57:25.539310 (+ 13us) write_op.cc:260] PREPARE: finished
0807 07:57:25.539465 (+ 155us) write_op.cc:270] Start()
0807 07:57:25.539589 (+ 124us) write_op.cc:276] Timestamp: P: 1786089445539416 usec, L: 0
0807 07:57:25.539609 (+ 20us) op_driver.cc:348] REPLICATION: starting
0807 07:57:25.540237 (+ 628us) log.cc:844] Serialized 849 byte log entry
0807 07:57:26.108717 (+568480us) op_driver.cc:464] REPLICATION: finished
0807 07:57:26.109121 (+ 404us) write_op.cc:301] APPLY: starting
0807 07:57:26.110436 (+ 1315us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:26.123463 (+ 13027us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:26.123601 (+ 138us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:26.123891 (+ 290us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:26.124118 (+ 227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 07:57:26.124165 (+ 47us) write_op.cc:312] APPLY: finished
0807 07:57:26.124376 (+ 211us) log.cc:844] Serialized 22 byte log entry
0807 07:57:26.124580 (+ 204us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:26.124666 (+ 86us) write_op.cc:454] Released schema lock
0807 07:57:26.124707 (+ 41us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:26.125105 (+ 398us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:26.125135 (+ 30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1556277,"reported_tablets":2,"spinlock_wait_cycles":60416,"child_traces":[["op",{"apply.queue_time_us":145,"apply.run_cpu_time_us":1923,"apply.run_wall_time_us":15926,"num_ops":1,"prepare.queue_time_us":68945,"prepare.run_cpu_time_us":2998,"prepare.run_wall_time_us":69853,"replication_time_us":568955}]]}
I20260807 07:57:26.437934 30429 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:26.439286 32744 raft_consensus.cc:2804] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:26.439705 32744 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:26.440076 32744 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.442518 30429 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:57:26.451606 32344 raft_consensus.cc:3055] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:26.451769 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:26.452070 32344 raft_consensus.cc:740] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:26.452550 30480 raft_consensus.cc:606] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:26.454041 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 07:57:26.455917 302 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.456466 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:26.457765 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:26.425153 30221 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53656 (request call id 203) took 7686 ms. Trace:
I20260807 07:57:26.470011 32376 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 07:57:26.500773 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 58403.5us
I20260807 07:57:26.501718 30429 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:26.502956 30429 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:26.506384 32543 raft_consensus.cc:2749] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:26.520305 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 120418us
I20260807 07:57:26.459860 30221 rpcz_store.cc:276] 0807 07:57:18.738761 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:18.738896 (+ 135us) service_pool.cc:224] Handling call
0807 07:57:26.425064 (+7686168us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:25.433817 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:25.434557 (+ 740us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:25.434606 (+ 49us) write_op.cc:435] Acquired schema lock
0807 07:57:25.434641 (+ 35us) tablet.cc:662] Decoding operations
0807 07:57:25.435012 (+ 371us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:25.435113 (+ 101us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:25.435145 (+ 32us) tablet.cc:685] Acquiring locks for 1 operations
0807 07:57:25.435511 (+ 366us) tablet.cc:701] Row locks acquired
0807 07:57:25.435543 (+ 32us) write_op.cc:260] PREPARE: finished
0807 07:57:25.435713 (+ 170us) write_op.cc:270] Start()
0807 07:57:25.435895 (+ 182us) write_op.cc:276] Timestamp: P: 1786089445435653 usec, L: 0
0807 07:57:25.435942 (+ 47us) op_driver.cc:348] REPLICATION: starting
0807 07:57:25.436631 (+ 689us) log.cc:844] Serialized 540 byte log entry
0807 07:57:25.704052 (+267421us) op_driver.cc:464] REPLICATION: finished
0807 07:57:25.890173 (+186121us) write_op.cc:301] APPLY: starting
0807 07:57:25.890277 (+ 104us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:25.890420 (+ 143us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:25.890566 (+ 146us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:25.890850 (+ 284us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:25.891105 (+ 255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 07:57:25.891162 (+ 57us) write_op.cc:312] APPLY: finished
0807 07:57:25.924721 (+ 33559us) log.cc:844] Serialized 22 byte log entry
0807 07:57:25.924912 (+ 191us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:25.924984 (+ 72us) write_op.cc:454] Released schema lock
0807 07:57:25.925035 (+ 51us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:25.925434 (+ 399us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:25.925463 (+ 29us) write_op.cc:454] Released schema lock
0807 07:57:26.108256 (+182793us) spinlock_profiling.cc:243] Waited 933 us on lock 0x7b54002a1a54. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f370a 00007fd6b52792f4 00007fd6b52792a3 00007fd6b5279218 00007fd6b52791d3 00007fd6b52784bc 00007fd6b52a21f6 00007fd6b528a09b 00007fd6b527477d 00007fd6b5278155
Metrics: {"mutex_wait_us":22180,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":182963,"apply.run_cpu_time_us":2221,"apply.run_wall_time_us":35223,"num_ops":1,"prepare.queue_time_us":82568,"prepare.run_cpu_time_us":7127,"prepare.run_wall_time_us":36638,"raft.queue_time_us":653167,"raft.run_cpu_time_us":11708,"raft.run_wall_time_us":444869,"replication_time_us":236446,"spinlock_wait_cycles":2146176,"thread_start_us":256402,"threads_started":4,"wal-append.queue_time_us":41830}]]}
I20260807 07:57:26.525079 30541 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.508208 32490 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:26.510679 32376 raft_consensus.cc:2804] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:26.530081 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:26.530611 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:26.531023 30373 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:26.531917 30220 catalog_manager.cc:5697] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:26.534060 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:26.534751 30358 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:26.535080 32673 raft_consensus.cc:2749] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:26.504714 32482 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.534363 30220 catalog_manager.cc:5697] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:26.542809 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:26.545975 30360 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.529062 32376 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:26.547015 30220 catalog_manager.cc:5697] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:26.549240 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:26.549755 30373 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.527573 32368 consensus_queue.cc:1048] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260807 07:57:26.558555 30541 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.560060 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:26.548378 32376 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:26.537277 32344 consensus_queue.cc:260] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.587826 310 raft_consensus.cc:2749] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:26.588248 32344 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.587298 30364 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:26.592604 30541 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.595631 30429 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:26.596959 30429 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:26.597160 32345 raft_consensus.cc:2764] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260807 07:57:26.598055 32744 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.600167 32744 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:26.607153 30477 raft_consensus.cc:1240] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:26.600018 32746 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:26.613938 32673 raft_consensus.cc:2749] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:26.614055 310 consensus_queue.cc:1059] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260807 07:57:26.638015 32673 raft_consensus.cc:3055] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:26.638455 32673 raft_consensus.cc:740] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:26.617785 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:26.639565 30364 raft_consensus.cc:2393] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:26.639271 32673 consensus_queue.cc:260] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:26.618820 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:26.618937 30490 raft_consensus.cc:1240] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:26.640544 32673 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.621536 30477 raft_consensus.cc:1275] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:26.641469 32243 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:26.633556 30480 raft_consensus.cc:1240] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:26.642016 32243 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:26.644133 311 consensus_queue.cc:1059] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:26.644968 311 raft_consensus.cc:3055] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:26.645294 32751 consensus_queue.cc:1048] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:26.637562 32746 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:26.647054 32417 consensus_queue.cc:1059] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:26.647267 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:26.647873 32417 raft_consensus.cc:3055] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:26.648217 32417 raft_consensus.cc:740] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:26.645267 311 raft_consensus.cc:740] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:26.650527 311 consensus_queue.cc:260] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.651609 311 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.649003 32417 consensus_queue.cc:260] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.654562 32417 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:26.644055 32243 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:26.634531 32482 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:26.647095 32746 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:26.671005 32746 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.674131 32746 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:26.677795 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 85291.9us
I20260807 07:57:26.678702 30541 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.680116 32243 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:26.681622 30541 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.687112 32746 raft_consensus.cc:993] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:26.687628 32744 raft_consensus.cc:1081] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:26.690207 32376 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.702116 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:26.706276 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:26.707243 30358 raft_consensus.cc:2393] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:26.709975 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:26.710676 30358 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 1.
I20260807 07:57:26.712255 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:57:26.715917 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:26.718389 30366 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:26.721802 30369 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
W20260807 07:57:26.722811 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:26.747049 30373 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:26.559811 30220 catalog_manager.cc:5697] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:26.748713 30220 catalog_manager.cc:5697] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:26.750852 30220 catalog_manager.cc:5697] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 3, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:26.757606 32243 raft_consensus.cc:2749] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 07:57:26.759817 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 78295.2us
I20260807 07:57:26.772392 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:26.776850 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:26.780447 30373 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:26.777748 30364 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:26.782261 30360 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:26.783427 30541 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:26.785979 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:26.790814 30220 catalog_manager.cc:5697] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:26.797335 302 raft_consensus.cc:2749] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:26.775274 32344 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:26.798604 30541 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.785560 30360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:26.806932 30220 catalog_manager.cc:5697] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:26.814670 30373 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:26.815989 30366 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:26.817229 30220 catalog_manager.cc:5697] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 3, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:26.819212 30220 catalog_manager.cc:5697] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 3, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:26.845664 30360 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:26.846107 30360 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:26.840706 32376 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:26.850704 30541 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.814317 32344 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.828807 306 raft_consensus.cc:2749] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:26.853825 30360 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:26.855228 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 59297.5us
W20260807 07:57:26.871332 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:26.906276 310 raft_consensus.cc:2749] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 07:57:26.937480 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 80032us
W20260807 07:57:26.941582 32754 log.cc:927] Time spent T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.082s user 0.005s sys 0.000s
W20260807 07:57:26.914034 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 63415.8us
W20260807 07:57:26.933362 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 73000.3us
W20260807 07:57:26.947050 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:26.948107 30541 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.950004 30429 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:26.950403 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:26.956247 30480 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:26.964641 30429 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:26.962759 32735 raft_consensus.cc:2749] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:26.968545 30429 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:26.969623 32377 raft_consensus.cc:2804] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:26.970584 30429 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:26.965860 30541 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.953622 32542 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260807 07:57:26.975291 32543 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:26.975818 32543 raft_consensus.cc:697] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:26.976987 32490 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:26.976691 32543 consensus_queue.cc:237] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.973546 32376 raft_consensus.cc:2804] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:26.978394 32376 raft_consensus.cc:697] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:26.979285 32376 consensus_queue.cc:237] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.964557 325 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:26.980690 30541 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.980324 32480 raft_consensus.cc:993] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:26.965796 32345 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260807 07:57:26.980854 325 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:26.982936 325 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:26.973770 30429 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:26.984961 30541 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:26.983106 30360 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:26.984520 30429 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:26.987392 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:26.988032 30477 raft_consensus.cc:3055] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:26.988400 30477 raft_consensus.cc:740] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:26.987443 30429 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:26.993422 310 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:26.990777 32345 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:26.994568 32345 raft_consensus.cc:697] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:26.995546 32345 consensus_queue.cc:237] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:26.998907 32344 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:26.984053 32480 raft_consensus.cc:1081] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:27.000531 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:27.001312 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:26.991062 32490 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:26.971701 32377 raft_consensus.cc:697] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:26.968113 32673 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260807 07:57:27.005363 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:27.012850 30477 consensus_queue.cc:260] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.014788 30541 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:27.014916 30477 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:26.990270 32368 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:26.989818 32746 raft_consensus.cc:993] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:27.019891 30541 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:27.015417 30360 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:27.012094 32745 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:27.024686 30366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:27.033851 30366 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:27.034243 30366 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:27.025514 32751 raft_consensus.cc:2749] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 07:57:27.036646 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 79626.8us
W20260807 07:57:27.015990 32542 consensus_queue.cc:1175] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b1188d7d3a0b455894bc443d571f6a19" responder_term: 5 status { last_received { term: 5 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 3 } }
I20260807 07:57:27.047256 30541 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:27.050860 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.040043 32482 raft_consensus.cc:1081] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:27.071277 30366 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.083851 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.084718 30579 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:27.077425 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:27.098767 30490 raft_consensus.cc:3055] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:27.099257 30490 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:27.099357 30360 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:27.102049 30366 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:27.102542 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.103121 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.103451 30590 raft_consensus.cc:2410] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:27.104113 30490 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.105932 30490 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:27.074342 32344 raft_consensus.cc:2749] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:27.111523 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.072407 32751 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:27.126997 30578 raft_consensus.cc:1240] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260807 07:57:27.128535 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.128710 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.129339 30587 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:27.129467 30590 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:27.132820 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.136096 30490 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
W20260807 07:57:27.137979 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 68004.6us
I20260807 07:57:27.139897 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.140496 30578 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:27.141579 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.141953 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.142412 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.142637 30578 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:27.090073 32377 consensus_queue.cc:237] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.143221 32669 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:27.143769 32669 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.144218 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.148623 32669 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:27.149295 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.150020 30578 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:27.142719 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.127521 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.155201 30477 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:27.126721 32745 raft_consensus.cc:697] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:27.177315 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.133317 32490 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:27.176575 30317 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:27.182744 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:27.186033 30317 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:27.135934 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.192939 30584 raft_consensus.cc:2393] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:27.188724 30585 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:27.191046 30582 raft_consensus.cc:2955] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:27.198000 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.198508 30588 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:27.182253 30579 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:27.189011 32140 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:27.196249 32669 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:27.207897 32669 raft_consensus.cc:697] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:27.208915 32669 consensus_queue.cc:237] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:27.210341 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.189354 32745 consensus_queue.cc:237] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.207325 32140 raft_consensus.cc:697] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:27.220996 32542 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:27.221675 32542 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.222270 30586 raft_consensus.cc:1240] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:27.220698 32140 consensus_queue.cc:237] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.184114 32490 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.210018 325 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:27.224424 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.230391 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.200172 32368 raft_consensus.cc:697] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:27.231381 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.231500 30588 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:27.230477 30429 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:27.242448 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.243134 30584 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:27.244187 30581 raft_consensus.cc:1240] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:27.245263 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.245855 30585 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:27.231241 32542 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:27.248270 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.249010 30578 raft_consensus.cc:2410] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:27.249807 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.252658 325 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:27.250887 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.255318 32490 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:27.255970 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.256420 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.257033 30581 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:27.256544 30588 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:27.258107 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.258589 30588 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 3
I20260807 07:57:27.262475 339 raft_consensus.cc:2804] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:27.262724 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.255334 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.270449 30578 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:27.271926 30480 raft_consensus.cc:1275] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:27.274374 30366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:27.274789 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.274921 30366 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:27.275385 30578 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:27.275835 30366 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:27.276407 30578 raft_consensus.cc:1240] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:27.276749 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:27.285127 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:27.285040 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.286212 30578 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 1.
I20260807 07:57:27.289165 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.289810 30581 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:27.289873 30367 raft_consensus.cc:1275] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:57:27.292893 30360 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:27.293095 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.295037 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:27.293965 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.293246 32673 consensus_queue.cc:1048] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260807 07:57:27.298636 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.299336 30584 raft_consensus.cc:2393] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:27.294556 30578 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:27.300351 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.301940 30578 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:27.310096 30429 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:27.232321 32368 consensus_queue.cc:237] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.311014 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.311859 30585 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:27.275573 339 raft_consensus.cc:697] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:27.312734 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.316453 30578 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:27.286353 32669 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:27.319202 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.319842 30585 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:27.321115 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.321826 30578 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:27.323192 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.323789 30578 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:27.325299 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.325627 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.326128 30585 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:27.332727 30366 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.334807 30588 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:27.332655 30578 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:27.343645 30581 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:27.346844 30373 raft_consensus.cc:1240] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3. Ops: []
W20260807 07:57:27.347538 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.316408 337 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:27.352689 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:27.353552 30367 raft_consensus.cc:2368] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4.
I20260807 07:57:27.353945 339 consensus_queue.cc:237] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.354697 30360 raft_consensus.cc:1240] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260807 07:57:27.356125 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:27.356676 30360 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:27.359697 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:27.360361 30369 raft_consensus.cc:2368] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4.
I20260807 07:57:27.348978 337 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:27.322026 32669 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.382165 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.382364 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:27.383208 30372 raft_consensus.cc:2410] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:27.383383 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.383976 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:27.385030 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:27.387194 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.395254 30584 raft_consensus.cc:2393] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:27.385643 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.396359 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:27.397060 30373 raft_consensus.cc:2393] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:27.395200 30372 raft_consensus.cc:2410] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260807 07:57:27.398694 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.399746 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:27.403131 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.404853 30588 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:27.405846 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.410763 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:27.411679 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 110732us
I20260807 07:57:27.412159 30578 raft_consensus.cc:2410] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 07:57:27.413185 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.414350 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:27.421348 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 61839.1us
I20260807 07:57:27.375883 337 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:27.418497 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:27.423790 30477 raft_consensus.cc:1240] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:27.424544 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.429633 30585 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:27.440986 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.442005 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:27.473474 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:27.474967 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.476769 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.477444 30588 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:27.480983 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:27.481601 30477 raft_consensus.cc:3055] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:27.481922 30477 raft_consensus.cc:740] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:27.400655 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:27.486874 30582 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260807 07:57:27.488572 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 66431.6us
I20260807 07:57:27.489346 30429 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:27.494818 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.513396 30541 leader_election.cc:400] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4.
I20260807 07:57:27.514580 30477 consensus_queue.cc:260] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.515588 30477 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:27.519549 30373 raft_consensus.cc:1240] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:27.520803 30541 leader_election.cc:400] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4.
I20260807 07:57:27.523785 30541 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:27.528501 30367 raft_consensus.cc:1240] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:27.520888 30373 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:27.533481 30588 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:27.535971 30372 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:27.538832 30367 raft_consensus.cc:1275] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:27.541399 30581 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:27.542922 30477 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:27.544636 30585 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:27.548974 30320 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:27.494226 30358 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
W20260807 07:57:27.546420 316 log.cc:927] Time spent T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.063s user 0.000s sys 0.000s
I20260807 07:57:27.568431 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:27.545238 32344 raft_consensus.cc:2749] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:27.543812 32376 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:27.572808 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:27.551011 347 log.cc:927] Time spent T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260807 07:57:27.574015 30477 raft_consensus.cc:1240] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:27.494391 32243 consensus_queue.cc:1059] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260807 07:57:27.531774 32345 consensus_queue.cc:1048] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260807 07:57:27.548424 345 log.cc:927] Time spent T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.061s user 0.000s sys 0.000s
W20260807 07:57:27.601984 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 53083us
I20260807 07:57:27.579138 32376 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:27.603269 30320 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:57:27.640195 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:27.642310 30480 raft_consensus.cc:2393] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:27.655077 30366 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:27.633728 32376 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:27.651661 30578 raft_consensus.cc:1240] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:27.636891 361 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
W20260807 07:57:27.692281 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 89162.1us
I20260807 07:57:27.695817 30581 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260807 07:57:27.705968 30430 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.708633 30320 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:27.689227 370 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:27.735634 30584 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:27.700202 383 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:27.739094 30482 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260807 07:57:27.741524 373 log.cc:927] Time spent T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.105s user 0.001s sys 0.000s
I20260807 07:57:27.744834 30358 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
W20260807 07:57:27.745950 356 log.cc:927] Time spent T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.108s user 0.000s sys 0.000s
W20260807 07:57:27.750988 30430 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.758242 30369 raft_consensus.cc:1240] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:27.699905 32669 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:27.706534 374 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:57:27.760039 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 228637us
I20260807 07:57:27.762841 30429 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:27.767808 30429 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
W20260807 07:57:27.769778 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 74398.7us
I20260807 07:57:27.738024 370 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:27.780491 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 71957.7us
I20260807 07:57:27.703624 361 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:27.769136 32345 raft_consensus.cc:2749] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:27.792423 32345 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:27.795595 361 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:27.797899 30587 raft_consensus.cc:1275] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260807 07:57:27.798556 368 log.cc:927] Time spent T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.103s user 0.001s sys 0.000s
I20260807 07:57:27.800792 30587 raft_consensus.cc:1240] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:27.802400 30317 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:27.802992 30320 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:27.760605 374 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:27.807423 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.779551 370 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:27.812140 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:27.812558 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.807168 311 raft_consensus.cc:2804] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:27.815675 32673 raft_consensus.cc:3055] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:27.816097 32673 raft_consensus.cc:740] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:27.811187 361 raft_consensus.cc:2749] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260807 07:57:27.826364 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 58698us
I20260807 07:57:27.830005 374 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:27.827407 311 raft_consensus.cc:697] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:27.834013 311 consensus_queue.cc:237] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:27.839792 349 log.cc:927] Time spent T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.459s user 0.003s sys 0.000s
I20260807 07:57:27.840592 337 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.841988 30479 raft_consensus.cc:1240] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:27.843060 337 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:27.816965 32673 consensus_queue.cc:260] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.844439 32673 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:27.847854 30429 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:27.855733 406 raft_consensus.cc:2804] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
W20260807 07:57:27.862301 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.863688 406 raft_consensus.cc:697] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:27.868589 370 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.869732 32744 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:27.877573 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:27.878824 32482 consensus_queue.cc:1059] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:27.879832 32744 raft_consensus.cc:3055] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:27.880223 32744 raft_consensus.cc:740] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:27.884692 30429 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:27.889213 30578 raft_consensus.cc:3055] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:27.889608 30578 raft_consensus.cc:740] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:27.890883 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:27.890793 30578 consensus_queue.cc:260] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.850766 325 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260807 07:57:27.894160 30588 raft_consensus.cc:1275] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260807 07:57:27.894523 30588 pending_rounds.cc:85] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e: Aborting all ops after (but not including) 2
I20260807 07:57:27.894738 30588 pending_rounds.cc:107] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260807 07:57:27.894960 30588 raft_consensus.cc:2889] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:27.897401 30578 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:27.877599 370 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:27.887509 32744 consensus_queue.cc:260] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.903455 32744 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:27.906381 406 consensus_queue.cc:237] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.919021 30581 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:27.919384 30578 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:27.921545 30587 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:27.926946 32376 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.932482 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:27.933638 30477 raft_consensus.cc:1275] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:27.934278 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:27.947132 30429 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:27.949628 30587 raft_consensus.cc:1275] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:27.951649 325 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:27.952175 325 raft_consensus.cc:697] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:27.952913 306 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:27.953006 325 consensus_queue.cc:237] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:27.966871 30480 raft_consensus.cc:1240] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6. Ops: []
W20260807 07:57:27.990688 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 143549us
I20260807 07:57:27.991556 30584 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:27.992268 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:27.993774 30320 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:27.994730 30587 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:28.003857 30584 raft_consensus.cc:1275] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 07:57:28.008762 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:28.009974 30365 raft_consensus.cc:1275] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:27.983610 32542 consensus_queue.cc:1048] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260807 07:57:28.011909 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:28.013550 30365 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:28.018805 30363 raft_consensus.cc:1275] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:28.021149 30360 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:28.023810 30323 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:28.030606 387 consensus_queue.cc:1048] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:28.035356 30367 raft_consensus.cc:1240] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
W20260807 07:57:28.013646 32140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s user 0.015s sys 0.017s
I20260807 07:57:28.041877 30364 raft_consensus.cc:1275] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:28.041646 30320 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:27.994735 403 consensus_queue.cc:1059] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260807 07:57:28.046684 30372 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:28.041718 30223 catalog_manager.cc:5697] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 3 to 5, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New cstate: current_term: 4 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260807 07:57:28.043195 32140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s user 0.015s sys 0.018s
I20260807 07:57:28.034269 396 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:28.051412 383 raft_consensus.cc:2764] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Leader pre-election decision vote started in defunct term 4: won
I20260807 07:57:28.051879 386 raft_consensus.cc:3055] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:28.050602 30429 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:57:28.052342 386 raft_consensus.cc:740] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:28.053395 386 consensus_queue.cc:260] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.054581 357 consensus_queue.cc:1059] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260807 07:57:28.054937 386 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:28.051295 396 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:28.049060 387 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 07:57:28.073407 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 49656us
I20260807 07:57:28.061767 32368 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election won for term 2
W20260807 07:57:28.077328 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:28.078011 30429 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:28.079609 30320 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:28.081504 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 54887.9us
I20260807 07:57:28.070284 370 raft_consensus.cc:2749] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:28.066039 396 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:28.077335 32368 raft_consensus.cc:697] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:28.085074 32482 raft_consensus.cc:2749] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:57:28.085443 32376 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:28.112784 32680 raft_consensus.cc:3055] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:28.114333 32368 consensus_queue.cc:237] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.139005 32680 raft_consensus.cc:740] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:28.139874 32680 consensus_queue.cc:260] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.141053 32680 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:28.083729 32744 consensus_queue.cc:1048] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260807 07:57:28.093283 406 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
W20260807 07:57:28.118330 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:28.121975 30320 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:28.146381 30320 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:28.147608 30320 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:28.125955 429 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:28.100921 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:28.164819 30320 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:28.153836 30223 catalog_manager.cc:5697] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 2 to 3, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129), VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130), VOTER f831a53ec51d452398015797d543164e (127.27.64.131), VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 4 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:28.173427 30320 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:28.174335 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 83476.3us
I20260807 07:57:28.175498 388 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:28.176362 388 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:28.176709 388 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:28.177135 371 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:28.177623 371 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.177065 388 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:28.179657 371 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:28.181846 30320 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:28.182355 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:28.187578 30320 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:28.161729 357 raft_consensus.cc:2749] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:28.162667 429 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:28.190871 429 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:28.192193 344 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260807 07:57:28.186307 325 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260807 07:57:28.185200 362 raft_consensus.cc:2749] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:28.183925 374 raft_consensus.cc:2749] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:28.184382 32542 consensus_queue.cc:1048] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260807 07:57:28.191560 32543 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260807 07:57:28.222715 30373 raft_consensus.cc:1275] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:28.220247 30320 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:28.190412 387 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:28.225425 387 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:28.272246 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:28.191995 371 raft_consensus.cc:2764] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260807 07:57:28.276417 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 56253.7us
W20260807 07:57:28.277941 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:28.280891 30320 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:28.287149 30320 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:28.288434 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:28.288873 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:28.288316 362 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:28.216573 394 consensus_queue.cc:1059] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
I20260807 07:57:28.299129 32543 consensus_queue.cc:1048] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:28.271056 387 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:28.303169 30320 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:28.279136 370 raft_consensus.cc:2804] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:28.317039 30220 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53660 (request call id 185) took 2615 ms. Trace:
I20260807 07:57:28.216477 396 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.321096 30320 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:28.321616 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:28.308147 357 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:28.317407 30220 rpcz_store.cc:276] 0807 07:57:25.701598 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:25.709183 (+ 7585us) service_pool.cc:224] Handling call
0807 07:57:25.799597 (+ 90414us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b54002a1a54. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b5260470 00007fd6b52ff31a 00007fd6bb0ef38c 00007fd6bb1ebbfe 00007fd6b96a54a4 00007fd6b96a5432 00007fd6b96a5361 00007fd6b96a52dc 00007fd6b96a4592 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:28.316977 (+2517380us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:27.080882 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:27.081524 (+ 642us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:27.081564 (+ 40us) write_op.cc:435] Acquired schema lock
0807 07:57:27.081583 (+ 19us) tablet.cc:662] Decoding operations
0807 07:57:27.082624 (+ 1041us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:27.082714 (+ 90us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:27.082745 (+ 31us) tablet.cc:685] Acquiring locks for 10 operations
0807 07:57:27.083585 (+ 840us) tablet.cc:701] Row locks acquired
0807 07:57:27.083604 (+ 19us) write_op.cc:260] PREPARE: finished
0807 07:57:27.083766 (+ 162us) write_op.cc:270] Start()
0807 07:57:27.083896 (+ 130us) write_op.cc:276] Timestamp: P: 1786089447083719 usec, L: 0
0807 07:57:27.083917 (+ 21us) op_driver.cc:348] REPLICATION: starting
0807 07:57:27.084673 (+ 756us) log.cc:844] Serialized 4033 byte log entry
0807 07:57:27.223236 (+138563us) op_driver.cc:464] REPLICATION: finished
0807 07:57:27.368845 (+145609us) write_op.cc:301] APPLY: starting
0807 07:57:27.374150 (+ 5305us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:27.385936 (+ 11786us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:27.386095 (+ 159us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:27.387432 (+ 1337us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:27.387658 (+ 226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0807 07:57:27.387700 (+ 42us) write_op.cc:312] APPLY: finished
0807 07:57:27.387946 (+ 246us) log.cc:844] Serialized 76 byte log entry
0807 07:57:27.388155 (+ 209us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:27.388280 (+ 125us) write_op.cc:454] Released schema lock
0807 07:57:27.388327 (+ 47us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:27.388684 (+ 357us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:27.388713 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":664,"reported_tablets":37,"spinlock_wait_cycles":75553024,"child_traces":[["op",{"apply.queue_time_us":134208,"apply.run_cpu_time_us":3659,"apply.run_wall_time_us":30222,"num_ops":10,"prepare.queue_time_us":126506,"prepare.run_cpu_time_us":4189,"prepare.run_wall_time_us":23363,"replication_time_us":139134,"thread_start_us":196900,"threads_started":2}]]}
W20260807 07:57:28.343793 30541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:28.312493 370 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:28.325999 371 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:28.328370 30320 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:28.320336 388 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.309664 394 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260807 07:57:28.332242 383 raft_consensus.cc:2804] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 07:57:28.432706 438 log.cc:927] Time spent T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.140s user 0.001s sys 0.000s
I20260807 07:57:28.349251 434 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:28.349609 370 raft_consensus.cc:3060] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:28.475098 406 raft_consensus.cc:3055] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:28.352844 371 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:28.420605 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:28.476764 429 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.538635 429 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:28.541455 371 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:28.530177 434 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.547554 434 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:28.530426 406 raft_consensus.cc:740] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:28.552829 30585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 1028) took 1172 ms. Trace:
I20260807 07:57:28.553237 30585 rpcz_store.cc:276] 0807 07:57:27.395391 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:27.577001 (+181610us) service_pool.cc:224] Handling call
0807 07:57:27.577302 (+ 301us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:28.007821 (+430519us) spinlock_profiling.cc:243] Waited 9.1 ms on lock 0x7b1800360c40. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb10bf31 00007fd6bb1186d1 00007fd6b4e9d6ac 00007fd6b21d2e3b 00007fd6bb07afc9 00007fd6b21eefdb 00007fd6b21ed2db 00007fd6b21ece05 00007fd6b52ee440 00007fd6b52eefdb 00007fd6b52f9a2b
0807 07:57:28.012861 (+ 5040us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:28.012880 (+ 19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:28.019970 (+ 7090us) log.cc:844] Serialized 26 byte log entry
0807 07:57:28.274380 (+254410us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:28.274417 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:28.274481 (+ 64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:28.552542 (+278061us) raft_consensus.cc:1685] finished
0807 07:57:28.552562 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:28.552769 (+ 207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43569,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":13962,"spinlock_wait_cycles":20934528,"thread_start_us":281723,"threads_started":2,"wal-append.queue_time_us":255293}
I20260807 07:57:28.555697 396 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:28.518517 337 consensus_queue.cc:1048] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
W20260807 07:57:28.558056 440 log.cc:927] Time spent T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260807 07:57:28.529174 32140 raft_consensus.cc:2804] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:28.559427 32140 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:28.559792 32140 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:28.563694 387 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.566047 387 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:28.420117 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 68147.8us
I20260807 07:57:28.507931 30590 consensus_queue.cc:237] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:28.511307 32751 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:28.586076 32751 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.588164 32751 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:28.525437 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:57:28.526685 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 198374us
I20260807 07:57:28.589494 30320 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:28.590615 30320 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:28.523752 437 log.cc:927] Time spent T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.092s user 0.000s sys 0.002s
I20260807 07:57:28.535398 30367 raft_consensus.cc:1240] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:28.548794 406 consensus_queue.cc:260] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.591857 396 raft_consensus.cc:2804] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:28.592581 396 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:28.592928 396 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:28.591863 30320 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:28.598026 429 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:28.598397 429 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:28.598757 429 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:28.599020 32751 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:28.599341 406 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:28.601457 374 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:28.601913 374 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:28.602255 374 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:28.606050 30320 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:28.609692 32673 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:28.609298 396 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.610214 32673 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.612134 396 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:28.609928 429 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.613329 32673 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:28.614039 362 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:28.614459 429 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:28.614830 32751 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.614444 362 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:28.617164 362 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:28.623301 30586 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:28.626483 362 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.628712 362 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:28.629500 396 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:28.629995 396 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.630807 30320 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:28.631949 396 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:28.632134 434 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:28.631971 30320 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:28.635222 396 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:28.635730 396 raft_consensus.cc:697] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:28.636623 396 consensus_queue.cc:237] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.314033 32746 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260807 07:57:28.583946 357 raft_consensus.cc:2749] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:28.640257 30320 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:28.519906 32368 consensus_queue.cc:1048] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260807 07:57:28.649199 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:28.642563 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:28.650373 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:28.651321 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:28.646128 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:28.650399 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:28.653187 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:28.519582 325 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260807 07:57:28.526211 383 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:28.655422 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:28.671229 30360 raft_consensus.cc:1240] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:28.672703 30360 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 07:57:28.648176 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:28.612736 370 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.629748 32751 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:28.675609 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:28.679169 30369 raft_consensus.cc:1240] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:28.674234 32243 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:28.681138 30363 raft_consensus.cc:1240] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:28.678681 306 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:28.682415 306 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.683845 30579 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:28.684422 306 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:28.636601 374 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.674103 383 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:28.643077 403 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:28.692356 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:28.695039 30586 raft_consensus.cc:1275] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:28.696550 30363 raft_consensus.cc:1240] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:28.697788 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:28.698485 30588 raft_consensus.cc:2393] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:28.673981 362 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:28.705142 30541 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:28.706707 30363 raft_consensus.cc:1240] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 1. Current term is 2. Ops: []
I20260807 07:57:28.724517 30360 raft_consensus.cc:1240] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 5. Current term is 6. Ops: []
I20260807 07:57:28.708950 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:28.725310 30579 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:28.617303 371 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.712096 30541 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:28.681097 32243 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.747845 30579 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:28.686889 374 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:28.726861 30541 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:28.758279 302 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:28.735298 371 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:28.712984 32744 consensus_queue.cc:1048] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260807 07:57:28.733508 30369 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:28.734167 30364 raft_consensus.cc:1240] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 5. Current term is 6. Ops: []
I20260807 07:57:28.702123 403 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:28.732831 32673 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:28.744777 386 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:28.722797 32140 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.765895 32751 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
W20260807 07:57:28.822274 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 147400us
I20260807 07:57:28.836405 30369 raft_consensus.cc:1275] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:28.764117 410 consensus_queue.cc:1059] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260807 07:57:28.841257 30363 raft_consensus.cc:1240] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
W20260807 07:57:28.849815 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:28.784502 32542 consensus_queue.cc:1059] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260807 07:57:28.785255 32368 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260807 07:57:28.851926 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:28.795802 32543 consensus_queue.cc:1059] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260807 07:57:28.820237 386 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:28.801592 344 consensus_queue.cc:1059] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
W20260807 07:57:28.858666 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 74344.3us
I20260807 07:57:28.848412 388 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:28.868229 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 99935.2us
I20260807 07:57:28.837939 32751 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.847934 302 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260807 07:57:28.846222 32746 consensus_queue.cc:1059] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260807 07:57:28.874023 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 177337us
I20260807 07:57:28.890983 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:28.892409 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:28.891026 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:28.893666 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:28.900718 30364 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260807 07:57:28.901098 30364 pending_rounds.cc:85] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19: Aborting all ops after (but not including) 1
I20260807 07:57:28.901309 30364 pending_rounds.cc:107] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260807 07:57:28.901569 30364 raft_consensus.cc:2889] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:28.867535 32673 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:28.911047 30360 raft_consensus.cc:1275] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:28.878444 370 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:28.912992 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:28.915962 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:28.941028 30365 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
W20260807 07:57:28.916949 453 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260807 07:57:28.869082 386 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:28.906361 325 raft_consensus.cc:3055] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:28.903486 410 raft_consensus.cc:3055] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:28.912955 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:28.922022 469 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:28.878157 371 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:28.909775 448 log.cc:927] Time spent T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.154s user 0.000s sys 0.001s
W20260807 07:57:28.957465 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 102143us
W20260807 07:57:28.977617 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 111566us
W20260807 07:57:28.988230 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 44844.2us
I20260807 07:57:28.994747 30364 raft_consensus.cc:1240] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:28.946677 32543 raft_consensus.cc:3055] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:28.999825 30364 raft_consensus.cc:1275] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:28.957263 325 raft_consensus.cc:740] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:28.976796 410 raft_consensus.cc:740] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:28.914352 32673 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.005795 410 consensus_queue.cc:260] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.006819 32673 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:29.007014 410 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:29.008400 32673 consensus_queue.cc:1048] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:28.944024 32542 consensus_queue.cc:1059] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260807 07:57:29.001410 32543 raft_consensus.cc:740] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:28.988570 437 log.cc:927] Time spent T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.086s user 0.000s sys 0.000s
I20260807 07:57:29.003644 32243 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:28.996764 32368 consensus_queue.cc:1059] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260807 07:57:28.995767 371 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:29.029557 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:57:29.036991 452 log.cc:927] Time spent T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.166s user 0.000s sys 0.001s
W20260807 07:57:29.037642 454 log.cc:927] Time spent T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.077s user 0.001s sys 0.000s
I20260807 07:57:29.014668 32140 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:29.041152 30429 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:29.010707 344 consensus_queue.cc:1048] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260807 07:57:28.990257 469 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:29.085189 344 consensus_queue.cc:1059] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260807 07:57:29.056993 371 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:29.058154 32744 raft_consensus.cc:3055] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:29.095192 32744 raft_consensus.cc:740] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:29.058454 474 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:29.059640 32480 raft_consensus.cc:3055] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:29.043511 32673 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:29.101703 30363 raft_consensus.cc:1240] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:29.074731 403 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:29.037050 31382 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:29.047231 325 consensus_queue.cc:260] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.110806 325 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:29.079259 32746 raft_consensus.cc:3055] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:29.113593 32746 raft_consensus.cc:740] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:29.113437 383 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.114586 30369 raft_consensus.cc:1240] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:29.080602 32542 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:29.115392 32542 raft_consensus.cc:697] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:29.116321 32542 consensus_queue.cc:237] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.083150 32543 consensus_queue.cc:260] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.117987 32543 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:29.118712 383 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:29.103262 32480 raft_consensus.cc:740] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:29.085592 406 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260807 07:57:29.086102 457 log.cc:927] Time spent T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.169s user 0.003s sys 0.000s
I20260807 07:57:29.100219 468 raft_consensus.cc:3055] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:29.123638 468 raft_consensus.cc:740] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:29.060606 32376 raft_consensus.cc:3055] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:29.083083 386 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:29.106576 32673 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:29.115088 462 log.cc:927] Time spent T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.070s user 0.001s sys 0.000s
I20260807 07:57:29.132192 32673 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:29.089934 469 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:29.079766 394 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:29.096035 32744 consensus_queue.cc:260] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.133991 32744 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:29.122098 32480 consensus_queue.cc:260] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.081858 32751 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:29.145363 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 144771us
I20260807 07:57:29.125998 32376 raft_consensus.cc:740] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:29.153244 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.153913 30476 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:29.160549 30480 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:29.161765 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.165679 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.168215 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:29.169804 32480 raft_consensus.cc:3060] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:29.124460 468 consensus_queue.cc:260] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.170800 468 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:29.175382 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.176898 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.177563 30487 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:29.178498 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.180123 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.182543 30476 raft_consensus.cc:2393] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 5: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:29.133066 394 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:29.186019 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 188046us
I20260807 07:57:29.211100 30541 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:29.142784 32673 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260807 07:57:29.114495 32746 consensus_queue.cc:260] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.238328 30539 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:29.250028 32376 consensus_queue.cc:260] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.173266 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:29.258656 30490 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:29.258927 30541 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:29.264091 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 179531us
I20260807 07:57:29.238698 403 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:29.256026 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:29.254747 469 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:29.241412 361 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:29.260103 32746 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
W20260807 07:57:29.272572 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:29.275475 30541 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:29.260907 386 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 07:57:29.313975 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:29.320920 306 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260807 07:57:29.324319 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 48902.8us
I20260807 07:57:29.330367 344 consensus_queue.cc:1059] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260807 07:57:29.330606 30539 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:29.331225 344 raft_consensus.cc:3055] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:29.331482 344 raft_consensus.cc:740] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:29.331681 30539 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:29.332129 344 consensus_queue.cc:260] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.333328 488 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:29.333828 488 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:29.334189 488 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:29.337538 361 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.325825 30487 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:29.317215 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:29.339432 489 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:29.339933 489 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:29.340283 489 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:29.339664 391 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:29.347590 488 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.326997 469 raft_consensus.cc:2749] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:29.322773 32751 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:29.328711 337 consensus_queue.cc:1059] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:29.350122 337 raft_consensus.cc:3055] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:29.350531 337 raft_consensus.cc:740] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:29.351380 337 consensus_queue.cc:260] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.352679 337 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:29.349020 32751 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.355844 32751 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:29.326510 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 51126us
I20260807 07:57:29.333230 344 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:29.370180 394 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:29.372017 30320 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
W20260807 07:57:29.380039 30430 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:29.382071 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.382664 30490 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:29.263566 32243 consensus_queue.cc:1048] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
W20260807 07:57:29.387063 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 149326us
I20260807 07:57:29.391858 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:29.393153 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:29.393816 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.394240 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:29.318097 32376 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:29.391292 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:29.399632 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:29.400254 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:29.407212 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:29.407819 30365 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:29.401043 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:29.408565 30487 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:57:29.275244 403 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.415944 30364 raft_consensus.cc:2393] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:29.412492 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:29.417816 30482 raft_consensus.cc:1275] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:29.419160 30539 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:29.415572 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:29.385571 388 raft_consensus.cc:2749] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 07:57:29.403712 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:29.423763 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:29.411427 486 log.cc:927] Time spent T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.095s user 0.001s sys 0.000s
W20260807 07:57:29.460332 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 59667.9us
I20260807 07:57:29.398470 484 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:29.315877 386 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:29.392287 488 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:29.465025 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.406450 483 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:57:29.481774 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 153088us
I20260807 07:57:29.426826 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:29.462044 475 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260807 07:57:29.508906 30429 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:29.468838 386 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:29.565826 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 51109.5us
I20260807 07:57:29.520597 30489 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:29.468320 406 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:29.468458 484 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.508423 475 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:29.631261 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:29.500638 410 consensus_queue.cc:1059] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.110s
I20260807 07:57:29.598968 469 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:29.641369 521 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:29.641692 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:29.643152 503 log.cc:927] Time spent T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260807 07:57:29.633728 32543 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260807 07:57:29.503088 483 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.631599 302 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:29.660708 410 raft_consensus.cc:3055] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:29.636624 475 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:29.610023 406 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.608716 32140 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260807 07:57:29.684157 492 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:29.673061 469 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.682726 498 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260807 07:57:29.687796 302 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.702793 469 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:29.703704 302 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:29.687888 410 raft_consensus.cc:740] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:29.689895 506 log.cc:927] Time spent T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.186s user 0.000s sys 0.004s
I20260807 07:57:29.704723 410 consensus_queue.cc:260] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.684253 339 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:57:29.707175 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 106997us
I20260807 07:57:29.707815 30369 raft_consensus.cc:1240] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
W20260807 07:57:29.688679 509 log.cc:927] Time spent T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.179s user 0.004s sys 0.000s
I20260807 07:57:29.672564 521 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.722466 489 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.724529 489 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:29.726161 403 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:29.694862 406 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:29.688480 361 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:29.708351 488 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:29.712144 410 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:29.730353 403 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:29.737854 403 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.733397 362 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260807 07:57:29.745621 526 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:29.746188 526 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:29.747299 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:29.749352 30223 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40988 (request call id 41) took 3312 ms. Trace:
W20260807 07:57:29.750115 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 287311us
I20260807 07:57:29.757308 30578 raft_consensus.cc:1240] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 07:57:29.763007 30585 raft_consensus.cc:1275] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:29.764771 30578 raft_consensus.cc:1240] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:29.713210 339 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.741175 403 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:29.771056 30590 raft_consensus.cc:1275] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:29.749742 30223 rpcz_store.cc:276] 0807 07:57:26.437136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:26.456230 (+ 19094us) service_pool.cc:224] Handling call
0807 07:57:29.749289 (+3293059us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:28.629401 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:28.630063 (+ 662us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:28.630098 (+ 35us) write_op.cc:435] Acquired schema lock
0807 07:57:28.630115 (+ 17us) tablet.cc:662] Decoding operations
0807 07:57:28.630520 (+ 405us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:28.630690 (+ 170us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:28.630718 (+ 28us) tablet.cc:685] Acquiring locks for 2 operations
0807 07:57:28.631042 (+ 324us) tablet.cc:701] Row locks acquired
0807 07:57:28.631058 (+ 16us) write_op.cc:260] PREPARE: finished
0807 07:57:28.631272 (+ 214us) write_op.cc:270] Start()
0807 07:57:28.631398 (+ 126us) write_op.cc:276] Timestamp: P: 1786089448631152 usec, L: 0
0807 07:57:28.631422 (+ 24us) op_driver.cc:348] REPLICATION: starting
0807 07:57:28.632066 (+ 644us) log.cc:844] Serialized 981 byte log entry
0807 07:57:29.355017 (+722951us) op_driver.cc:464] REPLICATION: finished
0807 07:57:29.641493 (+286476us) write_op.cc:301] APPLY: starting
0807 07:57:29.641581 (+ 88us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:29.641708 (+ 127us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:29.641866 (+ 158us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:29.642204 (+ 338us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:29.642370 (+ 166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 07:57:29.642413 (+ 43us) write_op.cc:312] APPLY: finished
0807 07:57:29.642653 (+ 240us) log.cc:844] Serialized 28 byte log entry
0807 07:57:29.642836 (+ 183us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:29.642924 (+ 88us) write_op.cc:454] Released schema lock
0807 07:57:29.642962 (+ 38us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:29.703210 (+ 60248us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b540011f680. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b8c7fb41 00007fd6b8d54d1d 00007fd6b8d4dda2 00007fd6b8d4d533 00007fd6b8d51741 00007fd6b8d516f9 00007fd6b8d51689 00007fd6b8d51651 00007fd6b8d5087d 00000000003aa554 00000000003aa399
0807 07:57:29.703411 (+ 201us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:29.703439 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":198517,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":282781,"apply.run_cpu_time_us":4229,"apply.run_wall_time_us":62003,"num_ops":2,"prepare.queue_time_us":346124,"prepare.run_cpu_time_us":30896,"prepare.run_wall_time_us":264566,"raft.queue_time_us":245901,"raft.run_cpu_time_us":54035,"raft.run_wall_time_us":341376,"replication_time_us":677444,"spinlock_wait_cycles":37694848,"thread_start_us":739354,"threads_started":4,"wal-append.queue_time_us":205602}]]}
I20260807 07:57:29.710144 492 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.778371 30429 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:29.784045 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:29.736940 488 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.771863 32744 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:29.770949 32751 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:29.715822 475 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.805583 30345 tablet_service.cc:1558] Processing DeleteTablet for tablet a6acbd1341f44b138a96457c583930e4 with delete_type TABLET_DATA_TOMBSTONED (TS b1188d7d3a0b455894bc443d571f6a19 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45034
I20260807 07:57:29.806995 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:29.807623 30587 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:29.776610 374 consensus_queue.cc:1048] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260807 07:57:29.791815 498 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:29.819574 30590 raft_consensus.cc:1240] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 5. Current term is 6. Ops: []
I20260807 07:57:29.825613 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:29.809127 30222 catalog_manager.cc:5697] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
W20260807 07:57:29.876080 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:29.829648 30222 catalog_manager.cc:5697] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 5, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:29.941354 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.950021 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:29.940192 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.940517 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:29.940754 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.795149 32744 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:29.947494 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 145929us
I20260807 07:57:29.939498 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:29.826248 30586 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:29.949304 30222 catalog_manager.cc:5697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 2 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 4 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:29.954083 30539 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:29.804682 325 consensus_queue.cc:1059] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.133s
I20260807 07:57:29.847651 403 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:29.956785 30480 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:29.952456 30479 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:57:29.958570 30222 catalog_manager.cc:5697] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:29.864173 484 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:29.810231 32751 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.968685 30222 catalog_manager.cc:5697] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 3, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:29.847908 371 raft_consensus.cc:476] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260807 07:57:29.937345 524 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:29.954721 344 consensus_meta.cc:287] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818: Time spent flushing consensus metadata: real 0.587s user 0.017s sys 0.001s
I20260807 07:57:29.979204 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:29.978667 30222 catalog_manager.cc:5697] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 3, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:29.959205 469 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:29.984414 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:29.955097 489 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:29.985630 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:29.996891 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:29.997669 30586 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:29.997905 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:29.999903 30581 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:29.984107 484 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election won for term 4
W20260807 07:57:30.001785 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 47762.6us
I20260807 07:57:30.006004 525 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:30.007865 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:30.017679 30372 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:30.009289 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:30.009635 32630 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:30.012346 522 log.cc:927] Time spent T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.202s user 0.000s sys 0.000s
W20260807 07:57:30.016394 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:30.015503 30581 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:29.970983 403 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.018476 30364 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:29.993178 483 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:30.037446 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:30.028406 551 tablet_replica.cc:333] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19: stopping tablet replica
W20260807 07:57:30.046955 30429 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:30.044202 30586 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:30.049355 30429 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:30.070542 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.072571 30581 raft_consensus.cc:2393] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 5: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:29.995509 489 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:29.994709 469 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.093005 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.094120 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.095172 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:30.104432 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:30.105088 30480 raft_consensus.cc:606] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:30.105417 30480 raft_consensus.cc:614] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 07:57:29.987062 524 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.035403 484 raft_consensus.cc:697] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:30.125720 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:30.018417 521 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.097903 394 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260807 07:57:30.128700 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 5df190e0d6d146e8a2f82d090c06ecdf (from ef1ca7acf52a438f89f14707e9e06818 to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:30.051088 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:30.141606 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:30.142338 30581 raft_consensus.cc:2393] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 6: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:30.143080 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:30.144079 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.145104 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:30.145615 30581 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:30.148290 546 log.cc:927] Time spent T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.103s user 0.000s sys 0.000s
I20260807 07:57:30.149750 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:30.150765 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.151365 30584 raft_consensus.cc:2393] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 6: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:30.151994 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:30.152443 30584 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
W20260807 07:57:30.154173 555 log.cc:927] Time spent T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
W20260807 07:57:30.158078 545 log.cc:927] Time spent T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.157s user 0.000s sys 0.001s
W20260807 07:57:30.159076 542 log.cc:927] Time spent T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.137s user 0.000s sys 0.000s
I20260807 07:57:30.039939 32630 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:30.161659 30585 raft_consensus.cc:1275] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:30.162947 32630 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:30.164798 30584 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:30.165365 32751 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.169217 30584 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:57:30.167815 30581 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:30.174731 524 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.108029 488 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:30.125833 386 consensus_meta.cc:287] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.513s user 0.009s sys 0.000s
I20260807 07:57:30.187956 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:30.215647 30369 raft_consensus.cc:2393] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:30.218849 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:30.220142 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:30.202991 30320 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.195578 30581 raft_consensus.cc:1275] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260807 07:57:30.216536 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:30.222738 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.223752 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.134323 394 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:30.139672 492 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:30.215680 30541 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:30.232793 30320 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.234403 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:30.236747 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:30.237437 30480 raft_consensus.cc:606] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:30.237790 30480 raft_consensus.cc:614] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 07:57:30.240940 30320 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.213063 474 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:30.244006 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 75bed1078db6464388c6bf0bea4a4be6 (from ef1ca7acf52a438f89f14707e9e06818 to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:30.244654 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:30.235339 394 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:30.250340 30373 raft_consensus.cc:2393] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:30.036715 525 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:30.229809 388 raft_consensus.cc:2749] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:57:30.253576 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:30.253940 30320 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:30.272485 30369 raft_consensus.cc:2393] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 2: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:30.214309 386 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.276499 30320 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:30.243297 362 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:30.243400 524 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:30.254562 30541 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:30.244184 461 raft_consensus.cc:2749] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:30.280392 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:30.282091 30320 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.282898 30373 raft_consensus.cc:2393] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 6: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:30.283466 30320 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.284017 30365 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 3.
I20260807 07:57:30.284698 30320 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.287240 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:30.288800 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:30.289500 361 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:30.289366 30369 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:30.293481 537 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:30.293565 371 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:30.294116 537 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.300350 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:30.302599 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 48126.8us
I20260807 07:57:30.303651 30541 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:30.305505 30541 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:30.285574 559 log.cc:927] Time spent T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.160s user 0.001s sys 0.000s
I20260807 07:57:30.280845 32140 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:30.311185 30584 raft_consensus.cc:1240] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:30.315596 30541 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:30.252625 474 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.329718 474 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.331976 30579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:30.334838 525 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:30.306720 521 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:30.335445 30476 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:30.309585 302 raft_consensus.cc:2749] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:30.336511 32243 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:30.343379 32243 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:30.344023 32243 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
W20260807 07:57:30.337941 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 53321.1us
I20260807 07:57:30.338162 30579 raft_consensus.cc:606] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:30.347152 30579 raft_consensus.cc:614] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 07:57:30.348910 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 7bb6a0a753b94f2c8b30e9ae87311e53 (from f831a53ec51d452398015797d543164e to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:30.348219 30320 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.351544 30487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:30.352437 30487 raft_consensus.cc:606] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:30.352808 30487 raft_consensus.cc:614] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 07:57:30.354153 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet af8f2d95eba240e2965db9be8b951bee (from ef1ca7acf52a438f89f14707e9e06818 to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:30.314252 337 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:30.250115 484 consensus_queue.cc:237] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.357658 30320 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.317260 403 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:30.360031 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 317109us
I20260807 07:57:30.331278 32140 raft_consensus.cc:697] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:30.375378 32140 consensus_queue.cc:237] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.360967 461 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 07:57:30.370160 531 log.cc:927] Time spent T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.283s user 0.000s sys 0.001s
I20260807 07:57:30.370519 556 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:30.370886 30539 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:30.374432 386 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.370923 30487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:30.381319 30487 raft_consensus.cc:606] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:30.381721 30487 raft_consensus.cc:614] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 07:57:30.379738 30320 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.383168 30539 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:30.383283 30541 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:30.385738 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.356484 474 raft_consensus.cc:2749] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:30.359328 361 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:30.391801 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.384135 485 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:30.369287 469 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.407099 30541 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:30.407774 485 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.409930 475 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.410118 485 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:30.404814 30320 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.410629 475 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:57:30.414309 30320 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.395874 32673 raft_consensus.cc:2764] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260807 07:57:30.382496 374 raft_consensus.cc:2749] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:57:30.361690 337 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.424357 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.402010 32751 raft_consensus.cc:2804] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 07:57:30.399127 383 raft_consensus.cc:2749] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:30.398382 556 raft_consensus.cc:697] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:30.431761 556 consensus_queue.cc:237] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.426337 30487 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:30.411795 525 raft_consensus.cc:2749] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:30.430194 337 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:30.427877 32751 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:30.445773 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.425268 461 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:30.448971 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.448359 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.459879 30579 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260807 07:57:30.462890 566 log.cc:927] Time spent T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.181s user 0.001s sys 0.000s
I20260807 07:57:30.466749 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.459126 30487 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:30.445678 32751 raft_consensus.cc:3060] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:30.473924 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:30.441692 361 raft_consensus.cc:2749] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 07:57:30.477229 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.477715 526 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.444881 337 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:57:30.466771 453 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4: Append to log took a long time: real 0.088s user 0.001s sys 0.001s
I20260807 07:57:30.445271 403 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:30.490137 32243 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.492482 32243 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:30.481760 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:30.494637 30478 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
W20260807 07:57:30.481067 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 81271.6us
I20260807 07:57:30.497179 31338 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.500564 510 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:30.502239 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.502961 30478 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
W20260807 07:57:30.503888 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:30.507282 394 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.510044 394 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:30.555984 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.493407 337 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.505185 32751 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.562630 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:30.569854 32744 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:30.583088 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.592233 495 raft_consensus.cc:3055] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:30.592705 495 raft_consensus.cc:740] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:30.593535 495 consensus_queue.cc:260] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.594561 495 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:30.597559 337 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:30.599664 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet e6f61d2b65b04216b54f6a2f8deadd0a (from ef1ca7acf52a438f89f14707e9e06818 to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:30.601682 30539 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:30.602823 30539 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:30.603228 489 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.603771 489 raft_consensus.cc:2764] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260807 07:57:30.604203 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:30.604928 30490 raft_consensus.cc:2368] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6.
I20260807 07:57:30.603610 403 raft_consensus.cc:2804] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:30.594576 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33928 (request call id 936) took 1277 ms. Trace:
I20260807 07:57:30.608945 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.606928 30476 rpcz_store.cc:276] 0807 07:57:29.316839 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:29.316965 (+ 126us) service_pool.cc:224] Handling call
0807 07:57:30.594389 (+1277424us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b5400368dd4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:30.594499 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491134720}
I20260807 07:57:30.608551 403 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:30.611011 30317 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:30.616596 403 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:30.617259 461 raft_consensus.cc:2804] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:30.617821 461 raft_consensus.cc:697] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:30.618676 461 consensus_queue.cc:237] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.623127 30539 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:30.624161 30539 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:30.624971 32243 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:30.625569 32243 raft_consensus.cc:697] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:30.626451 32243 consensus_queue.cc:237] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.627612 403 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.630405 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:30.631006 30476 raft_consensus.cc:606] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:30.631073 302 raft_consensus.cc:2804] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:30.631441 30476 raft_consensus.cc:614] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 07:57:30.631575 302 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:30.635810 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet f16f3d2817a34261bb25577fa0f9e2de (from ef1ca7acf52a438f89f14707e9e06818 to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:30.636353 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:57:30.638223 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:30.639428 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:30.636650 302 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:30.632014 469 raft_consensus.cc:2955] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:30.662034 30539 leader_election.cc:400] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6.
I20260807 07:57:30.662539 30539 leader_election.cc:403] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260807 07:57:30.631508 32751 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.665668 339 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:30.659207 406 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:30.678939 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:30.685142 551 raft_consensus.cc:2243] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 07:57:30.686080 551 raft_consensus.cc:2272] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:57:30.673813 406 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.702112 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.702675 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:30.703172 406 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:30.705932 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:30.707381 30373 raft_consensus.cc:1240] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:30.703297 30372 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:30.757867 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:30.706594 30367 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:30.707908 551 ts_tablet_manager.cc:1916] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:57:30.674067 32751 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:30.777966 30476 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
W20260807 07:57:30.785621 30430 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:30.786244 302 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:30.792342 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 207668us
I20260807 07:57:30.755530 488 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:30.794222 488 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.796195 488 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.796460 302 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.796801 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:30.764379 403 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.801220 488 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:30.814085 488 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.804270 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.816910 30590 raft_consensus.cc:2393] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 5: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:30.804543 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.805449 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:30.805692 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.818878 30584 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:30.806125 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.820133 30582 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:30.828641 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.830807 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.798774 30323 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:30.806713 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:30.807118 537 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:30.846098 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 47403.7us
I20260807 07:57:30.846356 396 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:30.803535 527 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:30.848034 527 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.806711 30539 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:57:30.850504 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 43870.3us
I20260807 07:57:30.803936 391 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:30.851372 489 raft_consensus.cc:2804] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:30.852142 489 raft_consensus.cc:697] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:30.853672 489 consensus_queue.cc:237] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.855269 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:30.855844 30482 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:30.857965 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.857642 30477 raft_consensus.cc:2955] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:30.860287 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:30.797330 31382 raft_consensus.cc:2955] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:30.867899 32751 raft_consensus.cc:2749] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6.
I20260807 07:57:30.874109 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.874915 30490 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:30.803045 302 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:30.880729 30539 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:30.887585 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:30.888304 30479 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:30.889595 472 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:30.890115 472 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:30.890616 472 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:30.900466 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:30.871876 527 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:30.851723 391 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.901201 30363 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:30.906183 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:30.906827 30365 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
W20260807 07:57:30.903716 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 489457us
I20260807 07:57:30.909966 30320 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.902566 30539 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:30.913801 388 raft_consensus.cc:2749] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:30.913852 32751 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:30.914636 32751 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:30.915189 32751 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:30.915444 30587 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:30.916527 388 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:30.888312 396 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:30.886937 488 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:30.913120 30429 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:30.919688 30578 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 2.
I20260807 07:57:30.926797 30482 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:30.920727 537 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:30.898988 302 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.920035 30360 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:30.934777 30579 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:30.930398 537 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:30.917321 388 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:30.939838 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:30.938433 482 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:30.947055 30320 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.949569 30539 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:30.952337 30320 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:30.953888 30358 raft_consensus.cc:1240] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
W20260807 07:57:30.959780 30366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s user 0.015s sys 0.016s
W20260807 07:57:30.960204 30366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s user 0.015s sys 0.016s
I20260807 07:57:30.979714 30488 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:30.955073 339 consensus_queue.cc:1059] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260807 07:57:30.960259 383 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 07:57:30.987550 556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s user 0.016s sys 0.014s
I20260807 07:57:30.978447 553 raft_consensus.cc:2749] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260807 07:57:31.050136 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 58023.4us
I20260807 07:57:31.055471 30360 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260807 07:57:31.056094 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 106610us
I20260807 07:57:30.959578 30320 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
W20260807 07:57:31.066187 556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s user 0.018s sys 0.015s
I20260807 07:57:31.066474 32376 consensus_queue.cc:1048] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260807 07:57:31.069715 339 raft_consensus.cc:3055] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:31.070147 339 raft_consensus.cc:740] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:31.070807 30429 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:31.071664 32744 raft_consensus.cc:2804] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:31.071453 339 consensus_queue.cc:260] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.072220 32744 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:31.072922 32744 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:30.985577 371 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:31.096503 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 136998us
I20260807 07:57:31.102425 30539 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:30.939093 396 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.050840 527 raft_consensus.cc:2804] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:31.073263 339 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:30.978228 482 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:31.111907 478 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s user 0.035s sys 0.043s
W20260807 07:57:31.118112 573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s user 0.012s sys 0.025s
I20260807 07:57:31.123121 388 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:31.123620 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:31.128153 458 raft_consensus.cc:2749] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:31.049669 495 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
W20260807 07:57:31.134490 362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s user 0.016s sys 0.021s
I20260807 07:57:31.142997 30365 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
W20260807 07:57:31.135926 32140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s user 0.019s sys 0.028s
W20260807 07:57:31.146245 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 43912.9us
I20260807 07:57:31.150509 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:31.103876 371 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.184829 388 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260807 07:57:31.164978 478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s user 0.035s sys 0.044s
W20260807 07:57:31.135316 453 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s user 0.008s sys 0.029s
I20260807 07:57:31.142164 302 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:31.161875 403 raft_consensus.cc:2804] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election won for term 4
W20260807 07:57:31.166556 573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s user 0.012s sys 0.027s
W20260807 07:57:31.170137 32140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s user 0.019s sys 0.029s
W20260807 07:57:31.168226 362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s user 0.016s sys 0.021s
I20260807 07:57:31.165580 527 raft_consensus.cc:697] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
W20260807 07:57:31.210391 453 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s user 0.008s sys 0.029s
W20260807 07:57:31.211560 469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s user 0.008s sys 0.029s
I20260807 07:57:31.218057 537 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:31.240301 469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s user 0.008s sys 0.030s
I20260807 07:57:31.210652 583 consensus_queue.cc:1048] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
W20260807 07:57:31.254858 584 log.cc:927] Time spent T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.095s user 0.001s sys 0.000s
W20260807 07:57:31.263187 30588 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s user 0.023s sys 0.052s
W20260807 07:57:31.263572 30588 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s user 0.023s sys 0.052s
W20260807 07:57:31.226485 461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s user 0.010s sys 0.010s
I20260807 07:57:31.275520 482 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:31.272676 461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s user 0.010s sys 0.010s
I20260807 07:57:31.288424 551 ts_tablet_manager.cc:1929] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.4
I20260807 07:57:31.289003 551 log.cc:1199] T a6acbd1341f44b138a96457c583930e4 P b1188d7d3a0b455894bc443d571f6a19: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root/wals/a6acbd1341f44b138a96457c583930e4
I20260807 07:57:31.271106 472 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.287313 396 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:31.290314 488 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.279675 527 consensus_queue.cc:237] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.297128 551 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45034 (request call id 60) took 1522 ms. Trace:
W20260807 07:57:31.308596 30487 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.605s user 0.022s sys 0.034s
W20260807 07:57:31.309811 30487 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.606s user 0.022s sys 0.035s
I20260807 07:57:31.301211 488 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:31.334813 526 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.341614 391 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:31.342881 306 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.302517 32744 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.314441 477 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:31.331838 32243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s user 0.011s sys 0.008s
W20260807 07:57:31.346949 484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s user 0.014s sys 0.017s
W20260807 07:57:31.363547 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 263740us
W20260807 07:57:31.358354 484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s user 0.014s sys 0.017s
W20260807 07:57:31.358419 32243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s user 0.011s sys 0.009s
W20260807 07:57:31.380434 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 249854us
I20260807 07:57:31.411087 371 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:31.411542 488 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:31.347785 32751 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.356787 302 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.415657 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:31.355957 489 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.418243 30320 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:31.418816 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:31.422425 30477 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:31.355289 526 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.356400 306 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.358002 477 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.433638 361 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:31.421782 472 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:31.429493 374 raft_consensus.cc:2804] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election won for term 4
W20260807 07:57:31.441133 30430 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:31.311702 551 rpcz_store.cc:276] 0807 07:57:29.781931 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:29.801833 (+ 19902us) service_pool.cc:224] Handling call
0807 07:57:30.017957 (+216124us) ts_tablet_manager.cc:1151] Deleting tablet a6acbd1341f44b138a96457c583930e4
0807 07:57:30.027988 (+ 10031us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0807 07:57:30.957433 (+929445us) tablet_metadata.cc:665] Metadata flushed
0807 07:57:31.285261 (+327828us) tablet_metadata.cc:665] Metadata flushed
0807 07:57:31.297029 (+ 11768us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":601201,"tablet-delete.queue_time_us":192391,"thread_start_us":140104,"threads_started":1}
I20260807 07:57:31.424484 302 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.439853 32376 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:31.474086 30541 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:31.436764 403 raft_consensus.cc:697] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:31.424499 489 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.486100 30541 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:31.487358 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:31.488857 30476 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:31.491814 30541 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:31.445341 306 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:31.446372 374 raft_consensus.cc:697] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:31.449251 391 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.496129 403 consensus_queue.cc:237] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.441282 361 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.443563 573 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260807 07:57:31.473654 472 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.447993 461 consensus_queue.cc:1048] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260807 07:57:31.447628 383 consensus_queue.cc:1059] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260807 07:57:31.489552 484 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:31.528430 470 raft_consensus.cc:2749] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:31.535257 30588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 1095) took 1723 ms. Trace:
I20260807 07:57:31.477579 32376 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.542546 526 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:31.533742 306 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:31.543352 32376 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:31.537700 30588 rpcz_store.cc:276] 0807 07:57:29.811683 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:29.823040 (+ 11357us) service_pool.cc:224] Handling call
0807 07:57:29.939483 (+116443us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:29.975462 (+ 35979us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:29.975491 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:30.013134 (+ 37643us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b2c00088908. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b3bf1c71 00007fd6b3c015d2 00007fd6b5331de1 00007fd6b52f681a 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22
0807 07:57:30.013539 (+ 405us) log.cc:844] Serialized 26 byte log entry
0807 07:57:30.100579 (+ 87040us) raft_consensus.cc:1645] Marking committed up to 2
0807 07:57:30.658665 (+558086us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b1800265b40. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb10bf31 00007fd6bb1186d1 00007fd6b21d27b7 00007fd6bb07afc9 00007fd6b21eefdb 00007fd6b21ed2db 00007fd6b21ece05 00007fd6b8d0dda7 00007fd6b5300d87 00007fd6b531049f 00007fd6b5310418
0807 07:57:31.268797 (+610132us) log.cc:844] Serialized 14 byte log entry
0807 07:57:31.534959 (+266162us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:31.535036 (+ 77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:31.535077 (+ 41us) raft_consensus.cc:1685] finished
0807 07:57:31.535088 (+ 11us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:31.535202 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48839,"prepare.queue_time_us":111908,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":31100,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":11037,"spinlock_wait_cycles":8042752,"thread_start_us":962031,"threads_started":3,"wal-append.queue_time_us":132726,"wal-append.run_cpu_time_us":1524,"wal-append.run_wall_time_us":1003121}
I20260807 07:57:31.544731 519 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:31.545308 519 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:31.548029 519 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:31.551249 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.523205 32744 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:31.506254 391 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.562170 32751 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:31.518661 472 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.564209 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:31.564812 30476 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
W20260807 07:57:31.563969 599 log.cc:927] Time spent T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.065s user 0.000s sys 0.001s
W20260807 07:57:31.570093 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:31.564122 612 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:57:31.567224 598 log.cc:927] Time spent T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
I20260807 07:57:31.580493 30477 raft_consensus.cc:1275] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:31.582857 612 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.584865 612 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:31.559490 374 consensus_queue.cc:237] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.586513 472 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:31.587760 391 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:31.593469 391 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:31.593964 391 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.593659 361 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:31.578779 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:31.596012 391 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:31.577410 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:31.600358 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 234022us
I20260807 07:57:31.601889 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:31.566256 469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34588 (request call id 62) took 3215 ms. Trace:
I20260807 07:57:31.612311 30429 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:31.617803 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:31.632368 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 139178us
I20260807 07:57:31.648355 30429 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:31.649407 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:31.655678 32376 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:31.656098 31336 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:31.649323 30429 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:31.624027 477 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:31.656476 478 raft_consensus.cc:2804] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:31.652945 613 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:31.660519 510 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:31.691484 30429 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:31.695696 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.728502 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:31.732010 30372 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:31.698531 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.717895 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:31.705856 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.698823 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:31.734740 30363 raft_consensus.cc:2393] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:31.734741 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.737655 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.737723 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:31.739625 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 48222.9us
W20260807 07:57:31.740213 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 209021us
I20260807 07:57:31.734122 30369 raft_consensus.cc:2368] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6.
I20260807 07:57:31.744005 30489 raft_consensus.cc:1240] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:31.745532 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:31.746853 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:31.747992 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:31.694383 478 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:31.695021 612 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.741622 30429 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:31.690728 582 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.768345 30579 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:31.751456 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:31.696612 362 raft_consensus.cc:3055] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:31.731815 458 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.694782 396 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.696566 477 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:31.790155 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.749769 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:31.781687 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:31.790630 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.750120 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:31.794167 339 consensus_meta.cc:287] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818: Time spent flushing consensus metadata: real 0.634s user 0.011s sys 0.000s
I20260807 07:57:31.616379 469 rpcz_store.cc:276] 0807 07:57:28.346433 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:28.346593 (+ 160us) service_pool.cc:224] Handling call
0807 07:57:28.588054 (+241461us) log.cc:844] Serialized 501 byte log entry
0807 07:57:31.560071 (+2972017us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":196,"raft.queue_time_us":199598,"raft.run_cpu_time_us":1656,"raft.run_wall_time_us":88963,"thread_start_us":442261,"threads_started":3,"wal-append.queue_time_us":259458,"wal-append.run_cpu_time_us":2700,"wal-append.run_wall_time_us":1187401}
I20260807 07:57:31.763724 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:31.766939 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:31.869488 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 128865us
I20260807 07:57:31.763656 608 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:31.775108 30372 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:31.878778 477 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.877883 396 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.882786 30429 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:31.885330 477 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:31.749676 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:31.807248 32751 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:31.885722 396 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:31.737113 587 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:31.741468 614 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.741866 619 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.873416 362 raft_consensus.cc:740] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:31.877056 30367 raft_consensus.cc:2393] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:31.886181 32751 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:31.887022 362 consensus_queue.cc:260] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.887451 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.889081 615 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:31.889632 615 raft_consensus.cc:697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:31.889570 614 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.890599 615 consensus_queue.cc:237] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.891438 587 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.872529 478 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:31.872722 30479 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:31.874352 582 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.883323 608 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:31.894325 608 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:31.894775 30366 raft_consensus.cc:2410] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 07:57:31.888820 619 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.888204 362 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:31.884557 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.895911 30372 raft_consensus.cc:2393] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 5: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:31.896660 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:31.896816 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:31.899003 32751 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:31.872114 32376 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:31.876922 30365 raft_consensus.cc:2393] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:31.879096 30373 raft_consensus.cc:2393] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:31.748126 631 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:31.901029 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.888175 30367 raft_consensus.cc:2393] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 3: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:31.906086 371 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:31.906761 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:31.907688 30372 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:31.909631 461 consensus_queue.cc:1059] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:31.909706 30365 raft_consensus.cc:2393] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:31.907333 631 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:31.912153 631 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:31.906992 582 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:31.908357 371 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.914753 587 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:31.915017 371 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:31.910717 396 raft_consensus.cc:3055] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:31.915649 396 raft_consensus.cc:740] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:31.916889 396 consensus_queue.cc:260] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.918082 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.919251 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.907799 30429 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:57:31.918154 396 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:31.911199 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.874514 612 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:31.920248 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.908624 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.955590 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:31.926142 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:57:32.002377 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 94518.2us
I20260807 07:57:31.930598 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:31.960022 30358 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
W20260807 07:57:31.953863 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:32.003742 30585 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:32.005440 30367 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:31.936563 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.934908 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:32.006572 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:32.007357 30367 raft_consensus.cc:2393] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 5: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:32.008369 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.013581 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:31.929283 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 39d207f188764d0caf032e77702cdc6b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260807 07:57:32.015345 30203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 86226.1us
I20260807 07:57:32.017127 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:32.017869 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:32.026273 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.028012 30372 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:32.020526 30364 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:31.950232 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:31.905021 32376 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:32.012428 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:32.030805 30363 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:31.878702 458 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.018641 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:31.915753 614 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:31.905547 556 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:31.921783 302 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.007052 337 raft_consensus.cc:2764] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260807 07:57:32.040153 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:32.042440 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:32.046170 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:32.040875 556 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:32.057368 556 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.032553 32376 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:31.921324 478 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.064970 478 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.069141 30373 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:32.071839 458 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.073179 619 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.074522 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.075649 30366 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:32.082859 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.084105 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:32.086171 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.089371 30541 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.090945 30541 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.096172 30541 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.078867 302 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:32.045872 30203 catalog_manager.cc:5028] TS b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): tablet a6acbd1341f44b138a96457c583930e4 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
W20260807 07:57:32.112303 30203 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 66461.6us
I20260807 07:57:32.114842 30320 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:32.110069 30541 leader_election.cc:400] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6.
I20260807 07:57:32.096659 32751 raft_consensus.cc:2749] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:32.113782 302 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.097644 477 raft_consensus.cc:2749] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:32.127843 302 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.111399 619 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:32.131407 30320 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:32.133770 30320 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:32.137064 30320 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:32.137255 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:32.142356 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 100427us
I20260807 07:57:32.146833 30541 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.129585 556 raft_consensus.cc:2749] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:32.151064 30541 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.137215 553 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:32.136778 639 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:32.158671 30541 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:32.141114 362 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:32.174005 30429 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:32.147943 527 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:32.169344 619 raft_consensus.cc:2804] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:32.157547 469 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:57:32.198356 30488 raft_consensus.cc:1275] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260807 07:57:32.210244 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 45413.4us
I20260807 07:57:32.159814 608 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.211448 30429 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:32.196288 32744 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 07:57:32.219770 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 74665.3us
I20260807 07:57:32.182863 619 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:32.224802 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:32.182027 613 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260807 07:57:32.225405 30365 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:32.216090 362 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:32.182204 527 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.228991 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:57:32.230129 662 log.cc:927] Time spent T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
W20260807 07:57:32.234412 651 log.cc:927] Time spent T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.098s user 0.001s sys 0.000s
I20260807 07:57:32.242017 612 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.244095 608 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.236218 30358 raft_consensus.cc:2410] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260807 07:57:32.223958 628 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:32.245087 628 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:32.245451 628 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:32.246901 30539 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:32.248266 30539 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:32.225458 489 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.212893 556 consensus_queue.cc:1048] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260807 07:57:32.253986 527 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.222234 619 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:32.236585 362 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.220897 32744 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:32.233081 32376 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.260771 631 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.265800 625 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:32.267505 470 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:32.268075 472 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260807 07:57:32.272219 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 57948.2us
I20260807 07:57:32.272905 30365 raft_consensus.cc:2468] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:32.264487 32243 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:32.275996 32243 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:32.277704 625 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.270110 32744 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:32.278419 32751 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260807 07:57:32.273730 472 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:32.287070 472 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:32.292819 30480 raft_consensus.cc:1240] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:32.291428 30541 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:32.299319 30429 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:32.295516 383 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:32.271392 470 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:32.301159 477 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:32.301888 30539 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.302351 362 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.303613 488 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:32.304641 30541 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.304673 32243 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:32.306259 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:32.307845 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.309425 510 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:32.334540 488 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.334944 510 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:32.336623 488 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.312064 625 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.337841 616 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:57:32.338263 616 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:32.338726 616 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:32.339319 30541 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:32.340793 302 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:32.318610 631 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.322369 30482 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:32.353072 611 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:32.341588 32751 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:32.326192 638 consensus_queue.cc:1059] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260807 07:57:32.327793 477 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:32.353874 611 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.344290 32243 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:32.354467 477 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:32.346457 614 raft_consensus.cc:2749] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:32.338182 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.341282 30541 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.357730 30541 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:32.327878 383 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.359467 362 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:32.358063 32243 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:32.360199 32243 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:32.359884 32751 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:32.328697 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:32.332779 615 raft_consensus.cc:2749] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:57:32.344063 30539 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:32.361157 30363 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:32.278335 628 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.360695 32751 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:32.362857 32751 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:32.363502 488 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:32.363994 488 raft_consensus.cc:697] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:32.341710 32376 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.343953 619 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.367404 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:32.361810 30541 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.360622 32243 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:32.341315 302 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.327979 470 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:32.371774 302 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.372032 403 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:32.372641 403 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:32.373126 32376 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:32.373864 32376 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.373006 403 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:32.348804 472 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.364830 488 consensus_queue.cc:237] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.376974 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.377743 30479 raft_consensus.cc:2393] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:32.378763 472 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.375628 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.379937 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.381354 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.397367 30478 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:32.391148 619 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.382853 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.384176 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.400870 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.337198 510 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.379846 638 raft_consensus.cc:3055] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:32.360828 383 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.374506 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.408890 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.411510 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:32.387765 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.395157 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.391862 32376 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.381636 32744 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.398859 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:32.395226 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 58213.1us
I20260807 07:57:32.401188 30480 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:32.434850 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.434785 30539 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.435282 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.404947 30363 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:32.413796 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.418299 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.441028 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:32.442929 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:32.418987 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.420123 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.420977 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.444370 30429 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:32.421727 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.408118 30223 catalog_manager.cc:5697] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:32.431480 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.406821 30220 catalog_manager.cc:5697] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 4 to 5, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:32.390829 628 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.433519 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:32.448359 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:32.448920 30364 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:32.450174 30487 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:32.450416 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.446437 30223 catalog_manager.cc:5697] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 4, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:32.451545 30223 catalog_manager.cc:5697] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:32.444439 30478 raft_consensus.cc:1240] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:32.452850 30223 catalog_manager.cc:5697] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:32.455957 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.455885 30223 catalog_manager.cc:5697] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 4 to 5, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 5 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:32.437019 30539 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:32.458184 30539 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.459290 30539 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.459830 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.460655 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:32.461140 30373 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:32.462231 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:32.465212 30489 raft_consensus.cc:1240] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 07:57:32.466328 30223 catalog_manager.cc:5697] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 4, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 4 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:32.452553 619 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:32.468223 30223 catalog_manager.cc:5697] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:32.469864 30223 catalog_manager.cc:5697] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 2, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 2 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:32.408284 638 raft_consensus.cc:740] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:32.459741 30480 raft_consensus.cc:2368] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4.
I20260807 07:57:32.629652 30222 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53640 (request call id 174) took 6433 ms. Trace:
I20260807 07:57:32.714098 30222 rpcz_store.cc:276] 0807 07:57:26.196453 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:26.239303 (+ 42850us) service_pool.cc:224] Handling call
0807 07:57:26.334615 (+ 95312us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b54002a1a54. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b5260470 00007fd6b52ff31a 00007fd6bb0ef38c 00007fd6bb1ebbfe 00007fd6b96a54a4 00007fd6b96a5432 00007fd6b96a5361 00007fd6b96a52dc 00007fd6b96a4592 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:32.619666 (+6285051us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:30.328091 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:30.328675 (+ 584us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:30.328712 (+ 37us) write_op.cc:435] Acquired schema lock
0807 07:57:30.328729 (+ 17us) tablet.cc:662] Decoding operations
0807 07:57:30.329551 (+ 822us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:30.329630 (+ 79us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:30.329660 (+ 30us) tablet.cc:685] Acquiring locks for 6 operations
0807 07:57:30.330172 (+ 512us) tablet.cc:701] Row locks acquired
0807 07:57:30.330186 (+ 14us) write_op.cc:260] PREPARE: finished
0807 07:57:30.330321 (+ 135us) write_op.cc:270] Start()
0807 07:57:30.330434 (+ 113us) write_op.cc:276] Timestamp: P: 1786089450330279 usec, L: 0
0807 07:57:30.330450 (+ 16us) op_driver.cc:348] REPLICATION: starting
0807 07:57:30.378323 (+ 47873us) log.cc:844] Serialized 2477 byte log entry
0807 07:57:31.275351 (+897028us) op_driver.cc:464] REPLICATION: finished
0807 07:57:31.567557 (+292206us) write_op.cc:301] APPLY: starting
0807 07:57:31.567645 (+ 88us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:31.567813 (+ 168us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:31.567921 (+ 108us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:31.589683 (+ 21762us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:31.589879 (+ 196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0807 07:57:31.589922 (+ 43us) write_op.cc:312] APPLY: finished
0807 07:57:31.590153 (+ 231us) log.cc:844] Serialized 52 byte log entry
0807 07:57:31.590321 (+ 168us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:31.590427 (+ 106us) write_op.cc:454] Released schema lock
0807 07:57:31.590473 (+ 46us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:31.590844 (+ 371us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:31.590872 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26480,"reported_tablets":27,"spinlock_wait_cycles":11540224,"child_traces":[["op",{"apply.queue_time_us":291975,"apply.run_cpu_time_us":2598,"apply.run_wall_time_us":23272,"num_ops":6,"prepare.queue_time_us":189203,"prepare.run_cpu_time_us":3729,"prepare.run_wall_time_us":71856,"replication_time_us":942710,"thread_start_us":287488,"threads_started":2}]]}
I20260807 07:57:32.608990 638 consensus_queue.cc:260] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.755781 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.758589 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:32.760608 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 301371us
I20260807 07:57:32.761539 30539 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.772982 30539 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.774473 30539 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:32.776909 30539 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.764958 32744 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:32.667912 679 log.cc:927] Time spent T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.160s user 0.001s sys 0.000s
I20260807 07:57:32.603948 30586 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:32.638595 608 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:32.474354 302 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:32.494894 30366 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:32.550793 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:32.608559 30364 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:32.472128 625 raft_consensus.cc:2749] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 07:57:32.694726 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 238673us
I20260807 07:57:32.829820 30429 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:32.567128 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:32.471554 30223 catalog_manager.cc:5697] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:32.832370 30223 catalog_manager.cc:5697] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 1 to 3, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } }
I20260807 07:57:32.472259 658 raft_consensus.cc:2804] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:32.597002 537 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:32.837723 537 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.839923 537 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.596717 371 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:32.840621 371 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.842730 371 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.678622 32243 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:32.568337 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:32.597474 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.844686 32243 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.845041 30582 raft_consensus.cc:1275] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:57:32.422876 489 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
W20260807 07:57:32.846339 686 log.cc:927] Time spent T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.085s user 0.000s sys 0.000s
I20260807 07:57:32.846091 489 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:32.801232 704 raft_consensus.cc:2749] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:32.848136 489 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:57:32.848030 693 log.cc:927] Time spent T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260807 07:57:32.855209 611 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:32.793257 638 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:32.861565 628 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:32.862107 628 raft_consensus.cc:697] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:32.863116 477 consensus_meta.cc:287] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.508s user 0.011s sys 0.000s
I20260807 07:57:32.862907 628 consensus_queue.cc:237] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.549606 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.863561 477 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.830945 472 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:32.826594 32751 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.868646 32751 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.564654 633 raft_consensus.cc:2749] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:32.828511 470 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.560685 30373 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:32.869871 658 raft_consensus.cc:697] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:32.604507 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.577699 30320 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:32.871404 470 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.618224 553 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:32.870987 658 consensus_queue.cc:237] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.872109 553 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:32.669816 685 log.cc:927] Time spent T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.147s user 0.001s sys 0.000s
W20260807 07:57:32.782680 681 log.cc:927] Time spent T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.145s user 0.001s sys 0.000s
I20260807 07:57:32.826253 302 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:32.873631 302 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:32.874157 30585 raft_consensus.cc:2393] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:32.874881 30579 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:32.829032 616 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:32.871706 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 294094us
W20260807 07:57:32.888839 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 58170.7us
I20260807 07:57:32.886533 30320 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:32.891234 32243 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:32.893513 30320 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:32.894737 30320 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
W20260807 07:57:32.895475 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 178932us
W20260807 07:57:32.876204 403 consensus_meta.cc:287] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.501s user 0.006s sys 0.007s
I20260807 07:57:32.898721 30320 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:32.901867 30429 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:32.902410 30320 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:32.904702 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33928 (request call id 983) took 1162 ms. Trace:
I20260807 07:57:32.905411 30320 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:32.905107 30477 rpcz_store.cc:276] 0807 07:57:31.742731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:31.742869 (+ 138us) service_pool.cc:224] Handling call
0807 07:57:31.753967 (+ 11098us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:31.754167 (+ 200us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:31.754190 (+ 23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:32.313289 (+559099us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b2c0005b888. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b3bf1c71 00007fd6b3c015d2 00007fd6b5331de1 00007fd6b52f681a 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22
0807 07:57:32.313670 (+ 381us) log.cc:844] Serialized 26 byte log entry
0807 07:57:32.332594 (+ 18924us) raft_consensus.cc:1645] Marking committed up to 3
0807 07:57:32.332634 (+ 40us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:32.332700 (+ 66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:32.902301 (+569601us) raft_consensus.cc:1685] finished
0807 07:57:32.902323 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:32.904635 (+ 2312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6915328,"thread_start_us":18643,"threads_started":1,"wal-append.queue_time_us":138592}
I20260807 07:57:32.889118 371 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:57:32.900265 583 raft_consensus.cc:2749] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:32.891981 619 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:32.904899 477 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:32.908236 688 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:32.900621 361 raft_consensus.cc:2749] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:32.828490 608 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:32.909943 671 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:32.904971 556 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:32.901684 669 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 07:57:32.971777 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 193633us
I20260807 07:57:32.953996 640 raft_consensus.cc:2749] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:32.970125 583 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:32.900888 704 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260807 07:57:32.911592 695 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260807 07:57:32.972432 693 log.cc:927] Time spent T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260807 07:57:32.906636 403 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:32.986809 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:32.912410 371 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:32.980216 688 raft_consensus.cc:697] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
W20260807 07:57:33.078047 692 log.cc:927] Time spent T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.108s user 0.000s sys 0.000s
I20260807 07:57:33.079079 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:33.079715 30590 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:33.080161 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:32.988196 526 consensus_queue.cc:1059] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.138s
I20260807 07:57:32.990384 583 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.081359 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:33.081691 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:33.087558 30590 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:33.121727 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:33.081596 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 97646.9us
W20260807 07:57:33.127349 30319 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:33.083693 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:33.114244 680 log.cc:927] Time spent T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.508s user 0.004s sys 0.009s
I20260807 07:57:33.151741 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:33.152936 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:33.081991 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:33.156939 30582 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:33.114583 631 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:33.081820 477 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:33.123631 553 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:33.125169 526 raft_consensus.cc:3055] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:33.070156 371 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:33.164253 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:33.180243 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 273659us
I20260807 07:57:33.149680 695 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:33.168488 30584 raft_consensus.cc:1240] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:33.103035 608 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:33.117611 478 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:33.175966 30539 leader_election.cc:400] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4.
I20260807 07:57:33.189177 30539 leader_election.cc:403] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260807 07:57:33.131274 706 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:33.164577 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 258629us
I20260807 07:57:33.183285 30582 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:33.194413 30582 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:33.183329 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:33.184425 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:33.184624 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:33.195690 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:33.195894 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:33.196380 30372 raft_consensus.cc:2368] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4.
I20260807 07:57:33.196852 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:33.197101 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:33.198611 30360 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:33.185911 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:33.199790 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:33.200022 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:33.177853 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:33.173941 587 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:33.206019 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:33.207535 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:33.208266 30373 raft_consensus.cc:2368] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6.
I20260807 07:57:33.189812 30584 raft_consensus.cc:1240] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:33.175429 526 raft_consensus.cc:740] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:33.211632 30429 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:33.209687 30541 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:33.218565 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:33.220336 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:33.221413 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:33.222364 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:33.222990 30373 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:33.217859 31338 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:33.167428 631 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:33.185034 583 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:33.230938 30584 raft_consensus.cc:1240] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:33.225868 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:33.228216 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:33.233340 30369 consensus_queue.cc:237] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:33.187865 669 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:33.179713 614 consensus_queue.cc:1059] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260807 07:57:33.175771 477 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.236814 30482 raft_consensus.cc:1240] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:33.224752 489 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4.
I20260807 07:57:33.241504 30541 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:33.234586 510 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:33.155139 688 consensus_queue.cc:237] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.202474 478 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.247735 30581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 1107) took 1320 ms. Trace:
I20260807 07:57:33.235074 676 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:33.258065 30582 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:33.240659 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:33.250335 30581 rpcz_store.cc:276] 0807 07:57:31.927472 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:31.941504 (+ 14032us) service_pool.cc:224] Handling call
0807 07:57:31.950310 (+ 8806us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:31.951270 (+ 960us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:31.951298 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:32.251505 (+300207us) spinlock_profiling.cc:243] Waited 9.6 ms on lock 0x7b2c00088908. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b3bf1c71 00007fd6b3c015d2 00007fd6b5331de1 00007fd6b52f681a 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22
0807 07:57:32.251931 (+ 426us) log.cc:844] Serialized 26 byte log entry
0807 07:57:32.320139 (+ 68208us) raft_consensus.cc:1645] Marking committed up to 3
0807 07:57:32.342597 (+ 22458us) log.cc:844] Serialized 14 byte log entry
0807 07:57:32.346235 (+ 3638us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:32.346320 (+ 85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:33.112651 (+766331us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b440002250c. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b2116855 00007fd6b2117272 00007fd6b4ea13bb 00007fd6b4e9cc9f 00007fd6b4e90a5e 00007fd6b4e8fda6 00007fd6b4e8f9c8 00007fd6b4e99411 00007fd6b4e993c9 00007fd6b4e99359
0807 07:57:33.247518 (+134867us) raft_consensus.cc:1685] finished
0807 07:57:33.247539 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:33.247673 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3352,"prepare.queue_time_us":22578,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":16354,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":882,"spinlock_wait_cycles":44528640,"thread_start_us":67839,"threads_started":1,"wal-append.queue_time_us":249834}
I20260807 07:57:33.259948 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:33.235482 715 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:33.188326 695 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.209794 706 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.223598 587 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:33.265877 30541 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:33.289817 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:33.249904 613 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:33.323256 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 57454.5us
I20260807 07:57:33.324030 30541 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:33.325768 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:33.327574 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:33.290477 488 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:33.239111 669 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.293833 403 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:33.332551 30429 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:33.322981 32376 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:33.354039 30541 leader_election.cc:400] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4.
I20260807 07:57:33.354216 30320 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:33.326859 472 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:33.354362 30429 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:33.336962 608 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260807 07:57:33.357758 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:33.361171 30479 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:33.261220 526 consensus_queue.cc:260] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.362646 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:33.362901 30541 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:33.363296 30489 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:33.364910 30320 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:33.371577 30320 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:33.355826 583 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:33.374693 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:33.356349 697 raft_consensus.cc:2749] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:33.373865 30358 consensus_queue.cc:237] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:33.381050 30541 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:33.302407 613 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.375594 396 consensus_queue.cc:1048] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260807 07:57:33.385598 613 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:33.386713 396 raft_consensus.cc:2749] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:33.371145 553 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260807 07:57:33.372112 32243 consensus_queue.cc:1059] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260807 07:57:33.371345 383 raft_consensus.cc:2749] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:33.390060 583 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.390866 706 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:33.392196 583 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:33.354565 727 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:33.395905 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:33.410763 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 56473.4us
I20260807 07:57:33.369804 671 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260807 07:57:33.415207 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 43767us
I20260807 07:57:33.417310 30320 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:33.418217 739 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:33.415607 32744 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:33.423391 30320 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:33.359582 32376 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.394392 633 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:33.436985 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:33.437166 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:33.437793 30482 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:33.438133 30476 raft_consensus.cc:2410] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 07:57:33.415508 32751 raft_consensus.cc:3055] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:33.443298 30541 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:33.446180 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:33.425441 488 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:33.462999 30317 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:33.426517 727 raft_consensus.cc:697] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:33.463913 30317 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:33.451673 718 log.cc:927] Time spent T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.185s user 0.000s sys 0.001s
I20260807 07:57:33.468900 396 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:33.469334 30541 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:33.469521 396 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:33.469967 396 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:33.470615 30541 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:33.471779 30541 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:33.436830 362 raft_consensus.cc:2804] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:33.444800 477 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:33.453505 32744 raft_consensus.cc:697] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:33.506057 30317 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:33.457603 631 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:33.500139 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:33.455832 32751 raft_consensus.cc:740] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:33.507879 30541 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:33.522527 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 44571.4us
I20260807 07:57:33.477200 403 raft_consensus.cc:2749] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:33.458986 614 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260807 07:57:33.478288 362 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:33.528577 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:33.528466 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:33.505371 472 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:57:33.489929 633 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:33.488195 478 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:33.489739 32243 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:33.524184 30541 leader_election.cc:400] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6.
I20260807 07:57:33.777827 30541 leader_election.cc:403] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260807 07:57:33.616031 30476 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:33.618578 31383 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:57:33.524865 715 raft_consensus.cc:2749] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260807 07:57:33.621326 302 consensus_meta.cc:287] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.747s user 0.004s sys 0.009s
W20260807 07:57:33.622332 683 log.cc:927] Time spent T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 1.010s user 0.010s sys 0.000s
I20260807 07:57:33.531104 671 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:33.825620 671 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:33.826066 671 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:33.509553 720 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:33.829586 720 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:33.829452 32744 consensus_queue.cc:237] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:33.626446 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 78554.8us
I20260807 07:57:33.831357 302 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:33.800040 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 275981us
W20260807 07:57:33.804934 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:33.616370 362 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:33.810050 32243 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.830008 720 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:33.520360 705 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:57:33.832958 30581 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:33.809254 470 raft_consensus.cc:2749] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6.
I20260807 07:57:33.856443 671 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.838160 32751 consensus_queue.cc:260] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.910462 32751 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:33.911319 671 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:33.860091 704 raft_consensus.cc:3055] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:33.918092 30478 raft_consensus.cc:1240] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 07:57:33.861852 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:33.821918 383 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:33.920745 383 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.922843 383 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:33.849633 302 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:33.880712 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:33.925279 31382 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:57:33.927898 30588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 1108) took 2000 ms. Trace:
W20260807 07:57:33.929860 371 consensus_meta.cc:287] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.745s user 0.004s sys 0.006s
I20260807 07:57:33.930277 371 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.832624 727 consensus_queue.cc:237] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.884266 777 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:33.876595 32376 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:33.888738 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:33.890543 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:33.928297 30588 rpcz_store.cc:276] 0807 07:57:31.927739 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:31.930845 (+ 3106us) service_pool.cc:224] Handling call
0807 07:57:32.256894 (+326049us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:32.271471 (+ 14577us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:32.271503 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:32.271936 (+ 433us) log.cc:844] Serialized 26 byte log entry
0807 07:57:32.288336 (+ 16400us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b18003123a0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb10bf31 00007fd6bb1186d1 00007fd6b21d27b7 00007fd6bb07afc9 00007fd6b21eefdb 00007fd6b21ed2db 00007fd6b21ef542 00007fd6b4e8f3fb 00007fd6b4e94f13 00007fd6b4e952c1 00007fd6b52b1def
0807 07:57:32.422616 (+134280us) raft_consensus.cc:1645] Marking committed up to 1
0807 07:57:32.422650 (+ 34us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:32.422723 (+ 73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:33.621650 (+1198927us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b440002250c. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b2116855 00007fd6b2117272 00007fd6b4ea13bb 00007fd6b4e9cc9f 00007fd6b4e90a5e 00007fd6b4e8fda6 00007fd6b4e8f9c8 00007fd6b4e99411 00007fd6b4e993c9 00007fd6b4e99359
0807 07:57:33.830140 (+208490us) raft_consensus.cc:1685] finished
0807 07:57:33.830163 (+ 23us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:33.927724 (+ 97561us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54001dd150. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f5c8d 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:33.927833 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15844,"raft.queue_time_us":16391,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":755196160,"thread_start_us":134126,"threads_started":1,"wal-append.queue_time_us":251832}
I20260807 07:57:33.891245 669 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:33.892318 616 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:33.892621 30365 raft_consensus.cc:1240] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:33.893217 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:33.895663 30320 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:33.900476 396 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.904402 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:33.904838 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:33.777729 695 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:33.915884 614 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:33.849932 587 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:33.943019 30477 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:33.917933 704 raft_consensus.cc:740] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:33.946285 770 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260807 07:57:33.895653 725 log.cc:927] Time spent T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.568s user 0.012s sys 0.020s
W20260807 07:57:33.949400 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 53801.4us
W20260807 07:57:33.971145 30429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s user 0.041s sys 0.109s
W20260807 07:57:33.972111 30429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s user 0.041s sys 0.109s
W20260807 07:57:33.972517 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 541720us
I20260807 07:57:33.973763 30429 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:33.929248 739 consensus_meta.cc:287] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.510s user 0.004s sys 0.001s
I20260807 07:57:33.974602 739 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:33.951211 30364 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:33.975497 722 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:33.975939 722 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:33.976261 722 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:33.970798 30367 raft_consensus.cc:2393] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 6: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:33.970489 614 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.981318 614 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:33.980993 704 consensus_queue.cc:260] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:33.981864 614 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:33.982095 704 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:33.950740 669 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:33.985474 30364 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:57:33.986016 638 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:33.968158 710 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:33.988118 638 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.017263 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:34.018257 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:34.018558 30365 raft_consensus.cc:1240] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:34.022927 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:33.986569 371 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:34.034665 616 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:34.035171 616 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.031759 30373 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:34.032346 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:34.032528 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:34.033262 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:34.037695 30369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s user 0.097s sys 0.176s
I20260807 07:57:33.987387 614 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.007313 710 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:34.007405 722 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:34.279796 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:34.108641 30429 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:34.319018 30358 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:34.319306 30365 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:34.321951 30365 raft_consensus.cc:1240] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3. Ops: []
I20260807 07:57:34.322274 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:34.041109 30372 raft_consensus.cc:1240] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7. Ops: []
W20260807 07:57:34.010185 658 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s user 0.003s sys 0.009s
W20260807 07:57:34.323101 30369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s user 0.112s sys 0.198s
I20260807 07:57:34.219276 30476 raft_consensus.cc:1275] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 07:57:34.107373 768 log.cc:927] Time spent T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.129s user 0.001s sys 0.000s
I20260807 07:57:34.325748 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:34.335371 30584 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:34.328248 30539 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:57:34.259626 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:34.336282 619 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election won for term 5
W20260807 07:57:34.328688 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 220106us
W20260807 07:57:34.339047 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:34.329797 32243 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:34.334275 30479 raft_consensus.cc:2393] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:34.171676 705 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
W20260807 07:57:34.336961 30317 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s user 0.006s sys 0.008s
W20260807 07:57:34.340812 30317 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s user 0.006s sys 0.008s
I20260807 07:57:34.341789 30429 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:34.327858 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:34.343706 30587 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:34.344822 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:34.345364 30587 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:34.336289 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:34.346853 30429 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
W20260807 07:57:34.334731 658 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.209s user 0.014s sys 0.028s
I20260807 07:57:34.349731 30317 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:34.315353 526 raft_consensus.cc:3060] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:34.350670 32243 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:34.147722 396 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:34.086196 638 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:34.318549 616 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:34.353754 30317 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:34.355667 32243 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.369625 30369 raft_consensus.cc:1240] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:34.370654 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:34.361904 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:34.335505 727 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:57:34.390327 30488 raft_consensus.cc:1240] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 07:57:34.388859 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:34.422514 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 68840.1us
I20260807 07:57:34.391603 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:34.337319 782 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:57:34.400920 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:34.388053 30358 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:34.349517 478 raft_consensus.cc:2749] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:34.459178 30488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33916 (request call id 1221) took 1222 ms. Trace:
I20260807 07:57:34.459599 30488 rpcz_store.cc:276] 0807 07:57:33.237049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:33.237149 (+ 100us) service_pool.cc:224] Handling call
0807 07:57:33.237949 (+ 800us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:34.422823 (+1184874us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:34.458906 (+ 36083us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001c8ed4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:57:34.459110 (+ 204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2650809472}
I20260807 07:57:34.447950 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:34.460791 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:34.461340 30586 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:34.462425 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:34.449087 30578 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:57:34.464816 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:34.467299 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:34.468626 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:34.469161 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:34.353423 619 raft_consensus.cc:697] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:34.211319 362 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.430294 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:34.432499 30587 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:34.469138 30477 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:34.435173 32243 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:34.437915 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:34.476253 30482 raft_consensus.cc:2393] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 6: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
W20260807 07:57:34.439122 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 91148.5us
I20260807 07:57:34.439633 32376 consensus_queue.cc:1059] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:34.440209 722 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:34.352726 607 raft_consensus.cc:2749] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:34.354305 669 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:34.428839 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:34.059237 720 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.421824 704 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:34.484829 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:34.536176 30585 raft_consensus.cc:1240] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7. Ops: []
I20260807 07:57:34.488583 30586 raft_consensus.cc:1240] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
W20260807 07:57:34.446964 32751 consensus_meta.cc:287] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.536s user 0.014s sys 0.001s
I20260807 07:57:34.533001 30478 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:34.542112 619 consensus_queue.cc:237] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.349229 705 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.566749 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:34.576534 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:34.537520 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:34.560869 30477 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:34.561415 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:34.579236 30584 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
W20260807 07:57:34.572520 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 88997.1us
I20260807 07:57:34.567217 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:34.439159 776 raft_consensus.cc:2804] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:34.549577 704 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.585180 722 raft_consensus.cc:3055] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:34.469870 782 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:34.591777 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 120274us
I20260807 07:57:34.682104 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:34.675235 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:34.718614 30482 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:34.710506 30586 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:34.570043 30578 raft_consensus.cc:1240] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:34.648294 30220 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40988 (request call id 44) took 2991 ms. Trace:
I20260807 07:57:34.733449 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:34.734210 30586 raft_consensus.cc:2393] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 4: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:34.589666 30360 raft_consensus.cc:2368] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6.
W20260807 07:57:34.589490 737 log.cc:927] Time spent T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
W20260807 07:57:34.724843 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 271204us
I20260807 07:57:34.717188 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
W20260807 07:57:34.643301 783 log.cc:927] Time spent T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.169s user 0.000s sys 0.000s
I20260807 07:57:34.749516 30541 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:34.642587 362 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:34.641773 788 log.cc:927] Time spent T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.144s user 0.000s sys 0.001s
W20260807 07:57:34.644174 779 log.cc:927] Time spent T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
I20260807 07:57:34.737269 776 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:34.750864 776 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:34.589030 773 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.165s
I20260807 07:57:34.752703 30490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33916 (request call id 1219) took 1516 ms. Trace:
I20260807 07:57:34.761642 30490 rpcz_store.cc:276] 0807 07:57:33.236465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:33.237125 (+ 660us) service_pool.cc:224] Handling call
0807 07:57:33.237440 (+ 315us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:33.295241 (+ 57801us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:33.295269 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:34.175600 (+880331us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b2c0005b888. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b3bf1c71 00007fd6b3c015d2 00007fd6b5331de1 00007fd6b52f681a 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22
0807 07:57:34.176011 (+ 411us) log.cc:844] Serialized 26 byte log entry
0807 07:57:34.341929 (+165918us) raft_consensus.cc:1645] Marking committed up to 2
0807 07:57:34.341970 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:34.342038 (+ 68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:34.752433 (+410395us) raft_consensus.cc:1685] finished
0807 07:57:34.752453 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:34.752647 (+ 194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1755,"raft.queue_time_us":23969,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":17517,"spinlock_wait_cycles":59931520,"thread_start_us":222758,"threads_started":2,"wal-append.queue_time_us":253521}
I20260807 07:57:34.753446 616 raft_consensus.cc:2749] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:57:34.754961 30541 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:34.757457 625 consensus_queue.cc:1048] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:34.758100 337 consensus_queue.cc:1059] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:34.765185 337 raft_consensus.cc:3055] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:34.765569 337 raft_consensus.cc:740] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:34.717070 722 raft_consensus.cc:740] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:34.768575 30482 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:34.768901 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:34.767547 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:34.770691 30490 raft_consensus.cc:1240] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260807 07:57:34.755105 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:34.645398 710 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:34.634627 705 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:34.777962 30541 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:34.736536 697 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:34.639201 614 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:34.641002 720 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:34.786653 782 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:34.787976 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:34.790670 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:34.732788 30220 rpcz_store.cc:276] 0807 07:57:31.668264 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:31.694037 (+ 25773us) service_pool.cc:224] Handling call
0807 07:57:34.648233 (+2954196us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:32.990273 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:33.098351 (+108078us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:33.098391 (+ 40us) write_op.cc:435] Acquired schema lock
0807 07:57:33.098410 (+ 19us) tablet.cc:662] Decoding operations
0807 07:57:33.098988 (+ 578us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:33.099076 (+ 88us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:33.099105 (+ 29us) tablet.cc:685] Acquiring locks for 1 operations
0807 07:57:33.099325 (+ 220us) tablet.cc:701] Row locks acquired
0807 07:57:33.099340 (+ 15us) write_op.cc:260] PREPARE: finished
0807 07:57:33.099611 (+ 271us) write_op.cc:270] Start()
0807 07:57:33.099749 (+ 138us) write_op.cc:276] Timestamp: P: 1786089453099532 usec, L: 0
0807 07:57:33.099766 (+ 17us) op_driver.cc:348] REPLICATION: starting
0807 07:57:33.100909 (+ 1143us) log.cc:844] Serialized 535 byte log entry
0807 07:57:34.009546 (+908637us) op_driver.cc:464] REPLICATION: finished
0807 07:57:34.433752 (+424206us) write_op.cc:301] APPLY: starting
0807 07:57:34.433855 (+ 103us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:34.433963 (+ 108us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:34.434126 (+ 163us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:34.434358 (+ 232us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:34.434532 (+ 174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 07:57:34.434576 (+ 44us) write_op.cc:312] APPLY: finished
0807 07:57:34.434767 (+ 191us) log.cc:844] Serialized 22 byte log entry
0807 07:57:34.434927 (+ 160us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:34.435000 (+ 73us) write_op.cc:454] Released schema lock
0807 07:57:34.435040 (+ 40us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:34.435373 (+ 333us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:34.435401 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":210332,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":379986,"apply.run_cpu_time_us":1665,"apply.run_wall_time_us":11533,"num_ops":1,"prepare.queue_time_us":515558,"prepare.run_cpu_time_us":38849,"prepare.run_wall_time_us":276044,"raft.queue_time_us":1051971,"raft.run_cpu_time_us":12826,"raft.run_wall_time_us":508165,"replication_time_us":896742,"thread_start_us":869410,"threads_started":4,"wal-append.queue_time_us":192492}]]}
I20260807 07:57:34.788093 704 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:34.772174 337 consensus_queue.cc:260] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.767416 658 consensus_queue.cc:1059] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260807 07:57:34.775691 625 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:57:34.795521 527 consensus_queue.cc:1059] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260807 07:57:34.835258 607 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
W20260807 07:57:34.837325 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 59436.2us
I20260807 07:57:34.835537 30539 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:34.835358 30429 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:34.809159 722 consensus_queue.cc:260] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:34.842687 710 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:34.854199 30429 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:34.854252 32243 consensus_queue.cc:1059] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:34.837524 697 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.852697 337 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:34.853044 478 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:34.871029 30541 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:34.875064 30429 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:57:34.871260 30579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s user 0.002s sys 0.022s
I20260807 07:57:34.856233 403 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:34.856418 625 raft_consensus.cc:697] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:34.878477 30541 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:34.852269 607 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:34.853773 32376 consensus_queue.cc:1175] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b1188d7d3a0b455894bc443d571f6a19" responder_term: 4 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 07:57:34.879017 658 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260807 07:57:34.879406 30579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s user 0.002s sys 0.022s
W20260807 07:57:34.906144 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:34.888943 614 raft_consensus.cc:2749] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:57:34.892700 403 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:34.895728 615 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:34.907712 705 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:34.911314 705 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:34.908143 793 log.cc:927] Time spent T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.088s user 0.000s sys 0.001s
I20260807 07:57:34.926482 607 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:34.909494 615 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:34.927994 615 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:34.930003 30360 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45054 (request call id 1035) took 1041 ms. Trace:
I20260807 07:57:34.930433 30360 rpcz_store.cc:276] 0807 07:57:33.888977 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:33.890324 (+ 1347us) service_pool.cc:224] Handling call
0807 07:57:34.929776 (+1039452us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b540023e954. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:57:34.929933 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1495326464}
I20260807 07:57:34.899189 658 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:34.936484 658 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:34.952481 362 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:34.940539 625 consensus_queue.cc:237] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.955847 30364 raft_consensus.cc:1240] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:34.958882 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:34.959584 30364 raft_consensus.cc:2393] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 6: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:34.962399 362 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.969800 362 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:34.972024 30317 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:34.973101 30317 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:34.974133 770 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:34.974503 770 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:34.974858 770 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:34.974579 30317 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:34.977563 739 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:34.982661 371 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:34.983208 371 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.984550 638 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:34.962349 615 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.990464 739 raft_consensus.cc:697] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:34.991063 615 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:34.991142 339 raft_consensus.cc:3055] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:34.993645 339 raft_consensus.cc:740] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:34.992969 31383 raft_consensus.cc:2955] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:34.994549 789 raft_consensus.cc:2955] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:34.985531 776 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.997484 638 raft_consensus.cc:697] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:34.997828 704 raft_consensus.cc:3055] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:34.998201 704 raft_consensus.cc:740] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:34.991396 739 consensus_queue.cc:237] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:34.994474 339 consensus_queue.cc:260] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.000473 339 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:35.001264 697 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:34.993249 771 raft_consensus.cc:2955] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:35.004613 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.007937 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:35.008538 30480 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:34.998993 704 consensus_queue.cc:260] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.009271 371 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:35.010579 704 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:34.999006 776 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:35.014094 30479 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:57:35.021498 658 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.024271 658 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:35.029451 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:35.029837 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:35.029448 31382 raft_consensus.cc:2955] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:35.030202 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:35.029886 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:34.998383 638 consensus_queue.cc:237] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.033646 773 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:35.034171 773 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:35.036425 722 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:35.037796 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:35.039559 773 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:35.031852 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.029768 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:35.044313 30480 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:35.047842 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:35.050009 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:35.058488 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 183064us
I20260807 07:57:35.062325 30320 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:35.064512 30320 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:35.065464 776 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:57:35.065903 776 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:35.066305 776 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:35.067869 705 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.068286 770 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.066016 773 consensus_queue.cc:1059] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:35.071561 30317 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:35.072304 587 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:35.072642 773 raft_consensus.cc:3055] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:35.073045 773 raft_consensus.cc:740] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:35.087263 30320 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:35.094992 30320 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:35.074110 339 consensus_queue.cc:1059] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260807 07:57:35.115335 30221 catalog_manager.cc:5697] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:35.077886 608 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260807 07:57:35.092236 640 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 07:57:35.119293 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 220197us
I20260807 07:57:35.093959 371 raft_consensus.cc:2749] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:57:35.077037 773 consensus_queue.cc:260] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.144021 773 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:35.104483 771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45034 (request call id 61) took 2588 ms. Trace:
I20260807 07:57:35.125753 30345 tablet_service.cc:1558] Processing DeleteTablet for tablet 39d207f188764d0caf032e77702cdc6b with delete_type TABLET_DATA_TOMBSTONED (TS b1188d7d3a0b455894bc443d571f6a19 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45034
I20260807 07:57:35.149591 771 rpcz_store.cc:276] 0807 07:57:32.523284 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:32.523494 (+ 210us) service_pool.cc:224] Handling call
0807 07:57:32.614399 (+ 90905us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b18000a00e0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b5331b1d 00007fd6b52fd31f 00007fd6b52fca93 00007fd6b52f4dda 00007fd6ba2ee2d9 00007fd6b3838db4 00007fd6b3838d42 00007fd6b3838c71 00007fd6b3838bec 00007fd6b3837ea2
0807 07:57:33.226791 (+612392us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b58004be9d0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b525248a 00007fd6b52d4827 00007fd6b52f1aea 00007fd6b52f2b4a 00007fd6b52f1cfb 00007fd6b52fd41c 00007fd6b52fca93 00007fd6b52f4dda 00007fd6ba2ee2d9 00007fd6b3838db4
0807 07:57:33.469145 (+242354us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b2c00051388. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b3bf1c71 00007fd6b3c00c6a 00007fd6b3c008f3 00007fd6b3c00891 00007fd6b53317d1 00007fd6b526adde 00007fd6b52f1b29 00007fd6b52f2b4a 00007fd6b52f1cfb 00007fd6b52fd41c 00007fd6b52fca93
0807 07:57:33.471052 (+ 1907us) log.cc:844] Serialized 501 byte log entry
0807 07:57:34.215096 (+744044us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b5400136620. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b526c19e 00007fd6b5276d10 00007fd6b5276cb8 00007fd6b5276c38 00007fd6b5276bf3 00007fd6b5275e7c 00007fd6bb19a996 00007fd6bb195148 00007fd6b52b2bab 00007fd6b52b56a0
0807 07:57:34.985468 (+770372us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b2c00051388. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b3bf1c71 00007fd6b3c00c6a 00007fd6b3c008f3 00007fd6b3c00891 00007fd6b5332f32 00007fd6b53330d5 00007fd6b526fa71 00007fd6b525028a 00007fd6b5257133 00007fd6b52570b9 00007fd6b5257049
0807 07:57:35.098877 (+113409us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3148,"raft.queue_time_us":104162,"raft.run_cpu_time_us":4085,"raft.run_wall_time_us":795147,"spinlock_wait_cycles":120254976,"thread_start_us":854093,"threads_started":2,"wal-append.queue_time_us":357305}
I20260807 07:57:35.117138 777 raft_consensus.cc:2804] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:35.154649 777 raft_consensus.cc:697] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:35.104686 720 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260807 07:57:35.126504 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.127169 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.160954 30429 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:35.128001 30478 raft_consensus.cc:1240] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:35.128722 30482 raft_consensus.cc:1240] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6. Ops: []
I20260807 07:57:35.132366 32376 consensus_queue.cc:1059] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:35.120911 556 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:35.136488 770 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:35.138633 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:35.139328 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:35.139923 30372 raft_consensus.cc:1275] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:35.140506 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:35.155598 777 consensus_queue.cc:237] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.134477 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:35.155958 834 log.cc:927] Time spent T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.066s user 0.000s sys 0.001s
I20260807 07:57:35.169565 30366 raft_consensus.cc:2368] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5.
I20260807 07:57:35.165253 30429 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:35.171082 30358 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260807 07:57:35.173350 30430 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:35.172034 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:35.176088 30487 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:35.177984 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:35.178754 30587 raft_consensus.cc:2393] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 6: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:35.179451 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:35.179690 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:35.180236 30578 raft_consensus.cc:2393] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 4: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:35.182593 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:35.183275 30582 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:35.185369 30581 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260807 07:57:35.185729 30581 pending_rounds.cc:85] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e: Aborting all ops after (but not including) 2
I20260807 07:57:35.185948 30581 pending_rounds.cc:107] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 07:57:35.186179 30581 raft_consensus.cc:2889] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:35.188267 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:35.188928 30586 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:35.192858 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:35.193439 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:35.194021 30586 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:35.193720 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:35.195008 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:35.195421 30541 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:35.195618 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:35.198091 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:35.200526 30586 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:35.199939 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:35.171572 640 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:35.167739 821 raft_consensus.cc:2749] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:35.202605 30584 raft_consensus.cc:1275] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:35.201606 30582 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:35.191092 789 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45034 (request call id 62) took 1821 ms. Trace:
I20260807 07:57:35.200237 339 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:35.205193 789 rpcz_store.cc:276] 0807 07:57:33.353558 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:33.353687 (+ 129us) service_pool.cc:224] Handling call
0807 07:57:33.397286 (+ 43599us) log.cc:844] Serialized 501 byte log entry
0807 07:57:35.174694 (+1777408us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6907,"raft.queue_time_us":102700,"raft.run_cpu_time_us":1528,"raft.run_wall_time_us":118770,"thread_start_us":577203,"threads_started":2,"wal-append.queue_time_us":119249,"wal-append.run_cpu_time_us":1879,"wal-append.run_wall_time_us":1209373}
I20260807 07:57:35.190259 705 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:35.208261 705 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.210355 705 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.198858 526 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:35.198843 556 raft_consensus.cc:697] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:35.211220 526 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.211887 640 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.214987 30487 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:35.226814 30586 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:35.213227 526 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.230556 846 tablet_replica.cc:333] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19: stopping tablet replica
I20260807 07:57:35.241204 705 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:35.241668 705 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:35.242079 705 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:35.422636 714 consensus_queue.cc:1059] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:35.423098 705 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.423759 607 raft_consensus.cc:3055] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:35.429211 607 raft_consensus.cc:740] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:57:35.429458 839 log.cc:927] Time spent T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.184s user 0.000s sys 0.007s
W20260807 07:57:35.430059 833 log.cc:927] Time spent T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.184s user 0.006s sys 0.001s
I20260807 07:57:35.430146 607 consensus_queue.cc:260] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.213896 556 consensus_queue.cc:237] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.425104 688 consensus_queue.cc:1059] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:35.432122 607 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:35.432806 776 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.430805 710 raft_consensus.cc:3055] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:35.434020 640 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:35.427120 608 raft_consensus.cc:3055] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:57:35.441546 705 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.443233 710 raft_consensus.cc:740] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:35.441891 688 raft_consensus.cc:3055] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:35.446509 688 raft_consensus.cc:740] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:35.446827 710 consensus_queue.cc:260] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.448170 710 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:35.448504 776 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:35.484553 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d30d61dc67614c5c9d0f1083e2a463b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260807 07:57:35.492792 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 312337us
I20260807 07:57:35.494637 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 14880a591ef44360b5046f67cab3d4ad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:57:35.508494 30223 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53660 (request call id 186) took 4605 ms. Trace:
I20260807 07:57:35.518653 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.520555 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.230938 30479 raft_consensus.cc:2955] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:35.523067 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:57:35.525842 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 288494us
I20260807 07:57:35.528426 30317 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:35.530246 30579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34604 (request call id 873) took 1360 ms. Trace:
I20260807 07:57:35.530925 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:35.536104 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:35.574462 30541 leader_election.cc:400] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6.
I20260807 07:57:35.573064 30579 rpcz_store.cc:276] 0807 07:57:34.170092 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:34.170320 (+ 228us) service_pool.cc:224] Handling call
0807 07:57:34.170701 (+ 381us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:34.171111 (+ 410us) raft_consensus.cc:1534] Early marking committed up to index 3
0807 07:57:34.318292 (+147181us) log.cc:844] Serialized 14 byte log entry
0807 07:57:35.168014 (+849722us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:35.168522 (+ 508us) log.cc:844] Serialized 26 byte log entry
0807 07:57:35.168730 (+ 208us) raft_consensus.cc:1645] Marking committed up to 4
0807 07:57:35.169023 (+ 293us) log.cc:844] Serialized 14 byte log entry
0807 07:57:35.205725 (+ 36702us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:35.205816 (+ 91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:35.529654 (+323838us) raft_consensus.cc:1685] finished
0807 07:57:35.529696 (+ 42us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:35.529997 (+ 301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72334,"prepare.queue_time_us":178532,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":13407,"raft.queue_time_us":42215,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":17338,"thread_start_us":868973,"threads_started":3,"wal-append.queue_time_us":589491}
I20260807 07:57:35.577157 30488 raft_consensus.cc:2393] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
W20260807 07:57:35.577688 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 49716.3us
I20260807 07:57:35.539721 30221 catalog_manager.cc:5697] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:35.583243 30488 raft_consensus.cc:1275] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:35.583627 640 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:35.584542 640 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.541798 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:35.585744 30541 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:35.575340 669 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:35.547044 30582 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:35.443490 608 raft_consensus.cc:740] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:35.550925 32751 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:35.551162 697 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:35.553761 625 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:35.553227 688 consensus_queue.cc:260] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.559305 30365 raft_consensus.cc:1240] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6. Ops: []
I20260807 07:57:35.551154 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:35.589286 30541 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:35.602674 720 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:35.623274 720 raft_consensus.cc:697] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:35.623585 30358 raft_consensus.cc:2393] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:35.627557 697 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.629598 688 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:35.630285 697 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.587658 828 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:35.597226 537 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:35.632046 537 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.634192 537 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:35.635164 625 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.637706 32751 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.640614 32751 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.589337 638 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:35.610787 669 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.653697 638 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.655977 638 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:35.656803 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:35.587344 640 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:35.658823 720 consensus_queue.cc:237] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.644440 625 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.624949 608 consensus_queue.cc:260] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:35.662449 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 73385.8us
I20260807 07:57:35.663546 30541 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:35.662560 608 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:35.667354 32751 raft_consensus.cc:2749] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:35.672060 625 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:35.672282 32751 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:35.672688 625 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:35.670029 403 raft_consensus.cc:2749] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:57:35.672955 32751 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.674850 625 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.675685 32751 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.663592 669 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:35.671783 30541 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:35.677664 32751 raft_consensus.cc:2749] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:35.682843 30487 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260807 07:57:35.686913 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:35.699157 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.700059 30476 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
W20260807 07:57:35.708930 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 145570us
W20260807 07:57:35.717573 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 165081us
W20260807 07:57:35.723816 30429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s user 0.017s sys 0.011s
W20260807 07:57:35.724328 30429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s user 0.017s sys 0.011s
W20260807 07:57:35.724666 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 531925us
I20260807 07:57:35.727924 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.731478 30482 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:35.723868 819 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260807 07:57:35.735934 608 consensus_queue.cc:1059] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:35.738732 853 raft_consensus.cc:3055] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:35.738993 860 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:35.739815 860 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:35.739200 853 raft_consensus.cc:740] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:35.738755 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.742856 853 consensus_queue.cc:260] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.744251 853 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:35.746404 30539 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:35.747885 30539 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:35.748695 625 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:35.749150 625 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:35.740351 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.749570 625 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:35.749320 30429 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:35.756136 32376 raft_consensus.cc:2749] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:35.750835 403 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:35.757907 403 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:35.758240 403 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:35.572584 30223 rpcz_store.cc:276] 0807 07:57:30.903366 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:30.903541 (+ 175us) service_pool.cc:224] Handling call
0807 07:57:30.939180 (+ 35639us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b5800032020. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b8a62 00007fd6bb184df9 00007fd6bb11dd56 00007fd6bb0ef248 00007fd6bb1ebbfe 00007fd6b96a54a4 00007fd6b96a5432 00007fd6b96a5361 00007fd6b96a52dc
0807 07:57:35.508217 (+4569037us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:33.288620 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:33.393528 (+104908us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:33.393566 (+ 38us) write_op.cc:435] Acquired schema lock
0807 07:57:33.393579 (+ 13us) tablet.cc:662] Decoding operations
0807 07:57:33.500713 (+107134us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:33.505114 (+ 4401us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:33.509160 (+ 4046us) tablet.cc:685] Acquiring locks for 10 operations
0807 07:57:33.902379 (+393219us) tablet.cc:701] Row locks acquired
0807 07:57:33.902395 (+ 16us) write_op.cc:260] PREPARE: finished
0807 07:57:33.902534 (+ 139us) write_op.cc:270] Start()
0807 07:57:33.902650 (+ 116us) write_op.cc:276] Timestamp: P: 1786089453902490 usec, L: 0
0807 07:57:33.902665 (+ 15us) op_driver.cc:348] REPLICATION: starting
0807 07:57:33.903290 (+ 625us) log.cc:844] Serialized 4029 byte log entry
0807 07:57:34.444523 (+541233us) op_driver.cc:464] REPLICATION: finished
0807 07:57:34.565873 (+121350us) write_op.cc:301] APPLY: starting
0807 07:57:34.576729 (+ 10856us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:34.668830 (+ 92101us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:34.681665 (+ 12835us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:34.733027 (+ 51362us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:34.750338 (+ 17311us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0807 07:57:34.750385 (+ 47us) write_op.cc:312] APPLY: finished
0807 07:57:34.750664 (+ 279us) log.cc:844] Serialized 76 byte log entry
0807 07:57:34.750838 (+ 174us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:34.750973 (+ 135us) write_op.cc:454] Released schema lock
0807 07:57:34.751030 (+ 57us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:34.751385 (+ 355us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:34.751413 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":163289,"reported_tablets":20,"spinlock_wait_cycles":4272512,"child_traces":[["op",{"apply.queue_time_us":27402,"apply.run_cpu_time_us":4024,"apply.run_wall_time_us":215150,"num_ops":10,"prepare.queue_time_us":430008,"prepare.run_cpu_time_us":5849,"prepare.run_wall_time_us":621931,"replication_time_us":479758}]]}
I20260807 07:57:35.764245 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.768564 30479 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:35.772017 32376 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260807 07:57:35.777851 30430 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:35.782416 32376 consensus_queue.cc:1059] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:35.784210 608 raft_consensus.cc:3055] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:35.784600 608 raft_consensus.cc:740] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:35.742041 860 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.785750 608 consensus_queue.cc:260] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.787485 608 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
W20260807 07:57:35.799292 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 214194us
I20260807 07:57:35.801221 770 consensus_queue.cc:1048] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260807 07:57:35.782308 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 63762.4us
I20260807 07:57:35.838656 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:35.840766 607 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:35.842025 860 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:35.841118 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:35.842594 770 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:35.844472 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:35.844256 770 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.846614 770 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:35.842691 860 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.850478 30429 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:35.851302 607 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:57:35.851472 860 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:35.839818 30479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:35.851888 607 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:35.852502 30479 raft_consensus.cc:606] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:35.852619 607 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:35.855791 625 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.859243 403 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:35.870476 30539 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:35.871448 32751 raft_consensus.cc:2804] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:35.871974 32751 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:35.872247 30476 raft_consensus.cc:1275] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:35.872408 32751 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:35.851850 30429 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:35.874410 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.875553 608 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 07:57:35.876744 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:35.878752 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:35.879397 30365 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:35.885593 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.888110 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:35.888871 30365 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:35.888950 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:35.889637 30364 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:35.893031 30479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:35.894345 30358 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:35.882519 32376 consensus_queue.cc:1048] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:35.899349 403 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.900959 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.899437 688 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:35.904027 30365 raft_consensus.cc:1240] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7. Ops: []
I20260807 07:57:35.903993 688 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.897073 30479 raft_consensus.cc:606] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:35.907709 688 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.907817 30479 raft_consensus.cc:614] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 07:57:35.912460 30360 raft_consensus.cc:1240] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7. Ops: []
I20260807 07:57:35.912542 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.915053 30482 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:35.899739 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.920851 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.926566 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:35.927299 30582 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:35.928689 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:35.929746 30586 raft_consensus.cc:1275] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260807 07:57:35.930109 30586 pending_rounds.cc:85] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e: Aborting all ops after (but not including) 2
I20260807 07:57:35.930308 30586 pending_rounds.cc:107] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 07:57:35.930539 30586 raft_consensus.cc:2889] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:35.932942 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:35.933905 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:35.921525 625 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.934717 30581 raft_consensus.cc:2393] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 5: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:35.934605 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:35.935680 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:35.910110 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 24224c3e18ec49578bb6c7bd4fd217b5 (from ef1ca7acf52a438f89f14707e9e06818 to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:35.928601 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:35.937793 30479 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:35.937956 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:35.939916 30429 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:35.941663 30590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:35.941619 30488 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:35.942399 30590 raft_consensus.cc:606] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:35.935443 32751 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.944116 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:35.944737 30476 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:35.948647 30479 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:35.951465 30539 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:35.955276 30539 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:35.961248 30479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:35.961971 30479 raft_consensus.cc:606] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
W20260807 07:57:35.962548 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:35.958264 30320 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:35.899456 607 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.961172 710 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:35.977584 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.981844 30490 raft_consensus.cc:2393] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 5: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:35.981218 710 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:35.982884 710 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:35.983997 30429 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:35.984833 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:35.977733 625 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:35.985572 30478 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
W20260807 07:57:35.986042 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 75062.3us
I20260807 07:57:35.986765 773 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:35.988274 607 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:35.986686 556 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:35.989501 556 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:35.989888 556 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:35.985828 32376 consensus_queue.cc:1048] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260807 07:57:35.977535 720 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:35.989656 625 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.996621 720 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.997695 30581 pending_rounds.cc:85] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e: Aborting all ops after (but not including) 2
I20260807 07:57:35.998055 30581 pending_rounds.cc:107] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260807 07:57:35.997901 556 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:35.998325 30581 raft_consensus.cc:2889] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:35.998636 720 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:35.998539 625 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:35.999992 556 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:36.001852 30429 leader_election.cc:400] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5.
I20260807 07:57:36.002197 30429 leader_election.cc:403] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260807 07:57:35.975844 403 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:36.021878 30476 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:35.976291 608 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:36.038938 30487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:36.039633 30487 raft_consensus.cc:606] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:36.039978 30487 raft_consensus.cc:614] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 07:57:36.041158 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:36.041896 30490 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:36.047168 669 consensus_queue.cc:1048] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:36.048139 30317 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:36.018925 710 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.051551 32376 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5.
W20260807 07:57:36.049476 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 78ad63a77c6546d6bc5db4234526fc78 (from ef1ca7acf52a438f89f14707e9e06818 to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:36.054476 30541 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:36.054770 710 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:36.049350 669 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:36.051777 30320 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
W20260807 07:57:36.057061 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 71771.8us
I20260807 07:57:36.063512 30317 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:36.058454 32751 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:36.062196 403 raft_consensus.cc:697] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:36.069962 846 raft_consensus.cc:2243] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 07:57:36.070207 403 consensus_queue.cc:237] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:36.032274 688 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:36.077972 688 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.080252 688 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:36.057787 669 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:36.081108 669 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:36.081209 32376 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:36.083302 773 consensus_queue.cc:1059] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:36.084194 773 raft_consensus.cc:3055] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:57:36.084537 773 raft_consensus.cc:740] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:36.085505 773 consensus_queue.cc:260] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.085880 30479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:36.086498 30479 raft_consensus.cc:606] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:36.086687 773 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:36.087903 556 raft_consensus.cc:2749] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:36.088325 30320 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:36.089699 860 raft_consensus.cc:2749] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:57:36.086892 30479 raft_consensus.cc:614] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 07:57:36.089784 30320 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:36.105567 861 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 07:57:36.105863 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 51455.8us
I20260807 07:57:36.107110 30541 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:36.102219 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:36.113770 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:36.114425 30476 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:36.117319 30363 raft_consensus.cc:1240] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260807 07:57:36.117599 625 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:36.119922 30539 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:36.124161 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:36.126142 30539 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:36.109252 861 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:36.127871 32751 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:36.131075 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:36.131671 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:36.134068 30490 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:36.124771 846 raft_consensus.cc:2272] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:57:36.113276 688 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:36.133692 32751 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:36.153527 32751 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:36.133843 861 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:36.138974 625 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:36.152321 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:36.140391 720 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:36.140086 527 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election won for term 6
W20260807 07:57:36.157673 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 67996.6us
W20260807 07:57:36.163468 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 56435.7us
W20260807 07:57:36.172616 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 9136a853c15441a6a0460d9da5efd3e9 (from ef1ca7acf52a438f89f14707e9e06818 to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:36.173238 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 07:57:36.163748 30588 raft_consensus.cc:2955] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:36.186658 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:36.190335 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:36.198210 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:36.175671 688 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.268368 30478 raft_consensus.cc:1275] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:36.272667 30477 raft_consensus.cc:1240] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 6. Current term is 7. Ops: []
I20260807 07:57:36.273466 30320 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:36.275173 30320 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:36.276659 846 ts_tablet_manager.cc:1916] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:57:36.280154 688 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:36.282119 872 log.cc:927] Time spent T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.141s user 0.001s sys 0.000s
I20260807 07:57:36.302174 30476 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:36.304139 587 consensus_queue.cc:1048] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:36.306273 658 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:36.307705 30320 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:36.240983 608 consensus_queue.cc:1059] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260807 07:57:36.318414 30320 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:36.320104 30320 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:36.281018 32751 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.309765 860 raft_consensus.cc:2749] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 07:57:36.323302 640 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:36.306823 658 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:36.337301 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 90871us
I20260807 07:57:36.350266 30429 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:36.333788 527 raft_consensus.cc:697] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:36.338567 770 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:36.368494 362 consensus_queue.cc:1048] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260807 07:57:36.373533 374 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:36.381680 727 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:36.382357 727 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.384712 727 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:36.352814 608 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 07:57:36.361155 556 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 07:57:36.389534 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 213369us
W20260807 07:57:36.423622 871 log.cc:927] Time spent T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.095s user 0.000s sys 0.000s
W20260807 07:57:36.433629 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 113600us
I20260807 07:57:36.436942 30320 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:36.443465 886 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:36.444128 886 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.441462 770 raft_consensus.cc:2749] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:36.443630 403 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:36.433732 625 raft_consensus.cc:2749] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:36.457959 403 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.458542 32751 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:36.460057 658 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:36.462256 30490 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
W20260807 07:57:36.465898 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 97534.4us
I20260807 07:57:36.446306 886 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:36.460117 403 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:36.482221 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:36.482856 30364 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:36.483623 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:36.484279 30366 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:36.490883 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:36.491655 30590 raft_consensus.cc:2368] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6.
I20260807 07:57:36.482007 527 consensus_queue.cc:237] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.494757 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:36.495401 30372 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 6
I20260807 07:57:36.496188 30582 raft_consensus.cc:1275] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260807 07:57:36.496541 30582 pending_rounds.cc:85] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e: Aborting all ops after (but not including) 3
I20260807 07:57:36.496763 30582 pending_rounds.cc:107] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260807 07:57:36.496991 30582 raft_consensus.cc:2889] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260807 07:57:36.498332 30430 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:36.499701 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:36.500430 30578 raft_consensus.cc:2393] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 5: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
W20260807 07:57:36.500731 869 log.cc:927] Time spent T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.329s user 0.002s sys 0.006s
I20260807 07:57:36.482954 770 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:36.502396 770 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.504530 770 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:36.499634 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:36.505440 30365 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
W20260807 07:57:36.508533 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 69177us
I20260807 07:57:36.506124 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:36.509996 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:36.510226 30539 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:36.509763 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:36.511020 30360 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:36.515367 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:36.462512 861 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.517732 30539 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:36.521006 32751 raft_consensus.cc:2804] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:36.528002 362 consensus_queue.cc:1059] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:36.495087 640 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:36.523408 30590 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:36.523814 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:36.525614 30585 raft_consensus.cc:1275] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:36.525887 773 raft_consensus.cc:3055] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:36.526268 885 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:36.539631 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:36.541561 885 raft_consensus.cc:697] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:36.530762 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:36.542582 885 consensus_queue.cc:237] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.527987 32751 raft_consensus.cc:697] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:36.480396 669 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } }
I20260807 07:57:36.544960 30482 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:36.544601 32751 consensus_queue.cc:237] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.546223 669 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:36.542114 710 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:36.529845 30429 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:36.553086 30363 raft_consensus.cc:2393] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 5: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:36.561156 638 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:36.561448 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:36.562083 30476 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:36.564131 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:36.536253 773 raft_consensus.cc:740] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:36.565577 891 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:36.566048 891 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:36.566413 891 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:36.568420 720 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:36.546995 640 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.570163 30477 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:36.570977 30365 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 6
I20260807 07:57:36.571308 640 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:36.573808 30476 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:36.576346 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:36.576418 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:36.577077 30364 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 6
I20260807 07:57:36.577188 30588 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:36.573305 556 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:36.578843 556 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:36.568967 720 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.584457 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:36.565850 773 consensus_queue.cc:260] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.585985 615 raft_consensus.cc:993] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:36.586491 615 raft_consensus.cc:1081] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:36.576614 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:36.589322 30541 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:36.586623 773 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:36.593142 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:36.593873 30476 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:36.589913 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:36.595005 30480 raft_consensus.cc:2393] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 5: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:36.588224 556 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.598054 556 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:36.591496 878 log.cc:927] Time spent T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.225s user 0.001s sys 0.002s
I20260807 07:57:36.604007 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:36.607322 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:36.608829 891 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.611032 891 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:36.597117 861 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:36.590027 710 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:36.623884 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:36.627369 30365 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:36.628018 30372 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:36.613971 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:36.631002 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:36.631536 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:36.632881 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:36.614223 770 raft_consensus.cc:3055] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:57:36.634363 770 raft_consensus.cc:740] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:36.635185 770 consensus_queue.cc:260] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.636407 770 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:36.637631 30477 raft_consensus.cc:2368] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6.
W20260807 07:57:36.617115 890 log.cc:927] Time spent T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.137s user 0.002s sys 0.000s
I20260807 07:57:36.639066 640 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:36.630363 30541 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:36.643035 892 raft_consensus.cc:2749] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 07:57:36.644515 403 raft_consensus.cc:993] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:36.644949 403 raft_consensus.cc:1081] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:36.646541 32376 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:36.647046 32376 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.648834 32376 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:36.650916 30541 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:36.612845 828 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:57:36.653200 30541 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:36.658439 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:36.616671 710 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:36.660871 30220 catalog_manager.cc:5697] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 3 to 5, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New cstate: current_term: 4 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:36.662047 710 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:36.662673 30220 catalog_manager.cc:5697] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 3 to 5, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New cstate: current_term: 4 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:36.664215 710 raft_consensus.cc:697] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:36.665737 710 consensus_queue.cc:237] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.680140 30317 leader_election.cc:400] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6.
I20260807 07:57:36.680583 30317 leader_election.cc:403] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:57:36.687892 30429 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:36.690985 32376 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:36.691398 32376 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:36.691720 32376 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:36.693362 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:36.694033 30579 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:36.694957 30586 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34594
I20260807 07:57:36.693229 899 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6.
I20260807 07:57:36.697496 899 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:36.697980 899 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.695583 30586 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:36.698947 30586 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:36.701994 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:36.705031 30477 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:36.689073 30364 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:36.693707 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:36.735103 30585 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 4
W20260807 07:57:36.735947 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 44009.5us
I20260807 07:57:36.746032 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:36.751240 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:36.751933 30369 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:36.757661 882 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:36.758265 882 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.758620 30539 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:36.760027 30539 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:36.760219 883 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:36.760782 883 raft_consensus.cc:697] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:36.761734 688 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:36.762198 30539 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:36.762959 886 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:36.763666 886 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:36.762228 688 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:36.766269 688 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:36.766506 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:36.770673 30541 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:36.772984 819 raft_consensus.cc:2749] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:36.773809 720 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:36.761674 883 consensus_queue.cc:237] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.808487 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:36.810595 30364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45054
I20260807 07:57:36.811233 30364 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:36.811599 30364 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:36.816313 30367 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260807 07:57:36.817762 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 129968us
I20260807 07:57:36.760336 882 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:36.761950 899 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:36.809273 30363 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:36.824345 30320 leader_election.cc:400] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6.
I20260807 07:57:36.824708 30320 leader_election.cc:403] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:57:36.826188 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:36.826917 30479 raft_consensus.cc:2368] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6.
I20260807 07:57:36.827538 30585 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:36.795970 625 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:36.834854 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:36.795089 819 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260807 07:57:36.839630 30317 leader_election.cc:400] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6.
I20260807 07:57:36.842391 30317 leader_election.cc:403] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:57:36.822772 362 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:36.849792 30476 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:36.872618 30429 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:36.882176 30364 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.845414 640 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6.
I20260807 07:57:36.837853 625 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.891726 30320 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:36.866433 892 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 07:57:36.897840 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 134534us
I20260807 07:57:36.907603 30364 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:36.909096 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 137006us
I20260807 07:57:36.908641 30317 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:36.911033 30320 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:36.854434 846 ts_tablet_manager.cc:1929] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260807 07:57:36.852396 362 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:36.896582 720 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 6
I20260807 07:57:36.924314 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:36.892308 638 consensus_queue.cc:1048] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260807 07:57:36.913337 669 raft_consensus.cc:2749] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 07:57:36.914143 374 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election won for term 5
W20260807 07:57:36.955394 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 82868.3us
I20260807 07:57:36.921769 640 raft_consensus.cc:2749] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:57:36.964154 846 log.cc:1199] T 39d207f188764d0caf032e77702cdc6b P b1188d7d3a0b455894bc443d571f6a19: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root/wals/39d207f188764d0caf032e77702cdc6b
I20260807 07:57:36.984833 909 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260807 07:57:37.011981 30369 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:36.993804 902 raft_consensus.cc:2804] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:36.925333 770 consensus_queue.cc:1048] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260807 07:57:37.035025 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:37.039795 32376 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.042456 362 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:37.044564 925 log.cc:927] Time spent T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.081s user 0.000s sys 0.000s
W20260807 07:57:37.046531 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 127694us
I20260807 07:57:37.047827 30541 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:37.054579 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:37.055236 30478 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:37.060503 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:37.018500 902 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:37.067371 32376 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:37.053085 907 log.cc:927] Time spent T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.112s user 0.001s sys 0.000s
I20260807 07:57:37.074668 30541 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:37.082720 30541 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:37.081426 30586 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.066730 902 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:37.084527 374 raft_consensus.cc:697] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:37.087961 527 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:37.096679 32751 raft_consensus.cc:2749] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:37.097913 403 raft_consensus.cc:2749] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 07:57:37.136071 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 53427.2us
I20260807 07:57:37.146857 30586 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:57:37.137976 910 log.cc:927] Time spent T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.105s user 0.000s sys 0.001s
I20260807 07:57:37.110040 688 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:37.178128 923 log.cc:927] Time spent T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.148s user 0.001s sys 0.000s
W20260807 07:57:37.194875 922 log.cc:927] Time spent T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.174s user 0.000s sys 0.001s
W20260807 07:57:37.196868 926 log.cc:927] Time spent T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.121s user 0.001s sys 0.000s
I20260807 07:57:37.197899 846 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45034 (request call id 63) took 2048 ms. Trace:
I20260807 07:57:37.198340 846 rpcz_store.cc:276] 0807 07:57:35.119998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:35.120147 (+ 149us) service_pool.cc:224] Handling call
0807 07:57:35.230155 (+110008us) ts_tablet_manager.cc:1151] Deleting tablet 39d207f188764d0caf032e77702cdc6b
0807 07:57:35.230226 (+ 71us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0807 07:57:36.574361 (+1344135us) tablet_metadata.cc:665] Metadata flushed
0807 07:57:36.846900 (+272539us) tablet_metadata.cc:665] Metadata flushed
0807 07:57:37.168312 (+321412us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":864070,"tablet-delete.queue_time_us":80355,"thread_start_us":337621,"threads_started":1}
I20260807 07:57:37.200172 30584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 1170) took 1014 ms. Trace:
I20260807 07:57:37.200519 30584 rpcz_store.cc:276] 0807 07:57:36.186032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:36.186163 (+ 131us) service_pool.cc:224] Handling call
0807 07:57:36.187982 (+ 1819us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:36.295819 (+107837us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:36.295849 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:36.304849 (+ 9000us) log.cc:844] Serialized 26 byte log entry
0807 07:57:36.699491 (+394642us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18003b3ec0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb10bf31 00007fd6bb1186d1 00007fd6b21d27b7 00007fd6bb07afc9 00007fd6b21eefdb 00007fd6b21ed2db 00007fd6b21ef542 00007fd6b4e8f3fb 00007fd6b4e94f13 00007fd6b4e952c1 00007fd6b52b1def
0807 07:57:36.853590 (+154099us) raft_consensus.cc:1645] Marking committed up to 2
0807 07:57:36.853642 (+ 52us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:36.853718 (+ 76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:37.199883 (+346165us) raft_consensus.cc:1685] finished
0807 07:57:37.199903 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:37.200115 (+ 212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99042,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":15142,"spinlock_wait_cycles":5377408,"thread_start_us":261274,"threads_started":2,"wal-append.queue_time_us":634482}
I20260807 07:57:37.165778 374 consensus_queue.cc:237] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.219707 688 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:37.225847 30478 raft_consensus.cc:2468] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:37.227531 928 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:37.229938 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:37.237756 30584 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:37.238715 892 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:37.239157 892 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:37.240854 720 raft_consensus.cc:2749] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6.
I20260807 07:57:37.236528 902 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.246667 902 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:57:37.251129 917 log.cc:927] Time spent T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.288s user 0.002s sys 0.012s
I20260807 07:57:37.250799 892 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.257603 860 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:37.263268 860 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.264654 954 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:37.265275 860 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:37.265120 954 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.260751 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:37.261816 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:37.263509 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:57:37.258467 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 173810us
I20260807 07:57:37.266964 30586 raft_consensus.cc:2368] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6.
I20260807 07:57:37.267719 30317 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:37.268883 954 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:37.268921 860 raft_consensus.cc:2804] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:37.270437 860 raft_consensus.cc:697] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:37.271351 860 consensus_queue.cc:237] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.284790 625 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:37.292443 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:37.293891 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:37.296332 30487 raft_consensus.cc:2393] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:37.298074 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:37.334919 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:37.335556 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:37.336158 30584 raft_consensus.cc:3055] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:37.336512 30584 raft_consensus.cc:740] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:37.337239 30584 consensus_queue.cc:260] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.338160 30584 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:37.339082 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:37.341820 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:37.342914 30363 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:37.343092 30429 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:37.343977 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:37.344149 30320 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:37.344525 30367 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:37.345254 30364 raft_consensus.cc:1275] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:37.347051 697 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:37.347203 773 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:37.347692 773 raft_consensus.cc:697] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:37.347544 697 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.348596 773 consensus_queue.cc:237] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.349714 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:37.352200 615 raft_consensus.cc:993] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:37.352658 615 raft_consensus.cc:1081] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:37.353075 669 raft_consensus.cc:2749] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:57:37.353792 669 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:37.354060 30585 raft_consensus.cc:1240] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:37.355321 697 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:37.356644 30320 leader_election.cc:400] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6.
I20260807 07:57:37.357491 30320 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:37.358461 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:37.360361 30320 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:37.363209 30320 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:37.372617 938 raft_consensus.cc:2749] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:57:37.372929 943 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:57:37.373879 30367 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:37.373308 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:37.375381 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:37.376037 30586 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:37.376976 30360 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:37.373359 938 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:37.392086 30581 raft_consensus.cc:1240] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:37.392266 30369 raft_consensus.cc:1240] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
W20260807 07:57:37.373713 710 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s user 0.028s sys 0.031s
I20260807 07:57:37.403622 32376 consensus_queue.cc:1059] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:37.404551 30584 raft_consensus.cc:2468] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:37.397989 30320 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:37.411309 948 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:37.378981 934 consensus_queue.cc:1059] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260807 07:57:37.420145 658 raft_consensus.cc:3055] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:37.420591 658 raft_consensus.cc:740] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:37.395257 938 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.421404 658 consensus_queue.cc:260] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.422560 658 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:37.422943 938 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:37.425027 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:37.418895 669 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:57:37.428519 892 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:37.431463 828 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:37.431979 828 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:37.416930 710 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s user 0.028s sys 0.032s
I20260807 07:57:37.435758 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:37.444756 30372 raft_consensus.cc:1275] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:37.449252 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:37.444242 828 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:37.436959 948 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.461495 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:37.465553 30586 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:37.466655 30429 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:37.468992 32376 raft_consensus.cc:2804] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:37.471349 32376 raft_consensus.cc:697] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:37.458922 720 raft_consensus.cc:2749] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:57:37.475310 615 raft_consensus.cc:3055] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:37.475051 32376 consensus_queue.cc:237] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.475917 615 raft_consensus.cc:740] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:37.477123 615 consensus_queue.cc:260] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.478569 615 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:37.483920 527 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:37.484448 527 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.484432 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:37.487840 30358 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:37.495765 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:37.496290 828 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:37.496444 30579 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
W20260807 07:57:37.477193 947 log.cc:927] Time spent T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.279s user 0.000s sys 0.003s
I20260807 07:57:37.503453 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:37.504446 30541 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:37.505141 30358 raft_consensus.cc:2393] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 6: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:37.512073 527 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:37.515214 30541 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:37.532639 32376 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:37.515875 625 consensus_queue.cc:1048] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260807 07:57:37.504376 819 consensus_queue.cc:1048] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260807 07:57:37.554088 30541 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:37.515257 828 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260807 07:57:37.563280 30320 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:37.516345 954 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:37.549367 32376 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.557624 527 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:37.558671 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:57:37.559664 956 log.cc:927] Time spent T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.096s user 0.000s sys 0.000s
W20260807 07:57:37.560559 967 log.cc:927] Time spent T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.055s user 0.001s sys 0.000s
I20260807 07:57:37.567667 30358 raft_consensus.cc:1240] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:37.568400 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:57:37.557516 912 log.cc:927] Time spent T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.577s user 0.003s sys 0.007s
I20260807 07:57:37.570900 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:37.576228 30372 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:37.581717 30367 raft_consensus.cc:1240] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 3. Current term is 4. Ops: []
I20260807 07:57:37.551812 883 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:37.592821 30366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:37.570019 527 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:37.593343 30366 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:37.594959 30366 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:37.595435 32376 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:37.597002 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:37.584167 954 raft_consensus.cc:697] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:37.608290 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:37.611826 30429 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:37.615362 32376 raft_consensus.cc:2749] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:57:37.598124 527 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:37.602101 908 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:57:37.624821 30372 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:37.622140 908 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:37.641520 30482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33928 (request call id 1100) took 1094 ms. Trace:
I20260807 07:57:37.641981 30482 rpcz_store.cc:276] 0807 07:57:36.547030 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:36.547566 (+ 536us) service_pool.cc:224] Handling call
0807 07:57:36.547864 (+ 298us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:57:36.548160 (+ 296us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:57:36.548188 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:57:36.556944 (+ 8756us) log.cc:844] Serialized 26 byte log entry
0807 07:57:36.836217 (+279273us) raft_consensus.cc:1645] Marking committed up to 3
0807 07:57:36.836259 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:57:36.836327 (+ 68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:57:37.504551 (+668224us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b24000d67d8. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b2076594 00007fd6b207469b 00007fd6b22306d9 00007fd6b2230365 00007fd6b222f9ad 00007fd6b4e792fe 00007fd6b4e90a7c 00007fd6b4e8fda6 00007fd6b4e8f9c8 00007fd6b4e99411
0807 07:57:37.633624 (+129073us) raft_consensus.cc:1685] finished
0807 07:57:37.633645 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:57:37.641431 (+ 7786us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6867,"spinlock_wait_cycles":13081344,"thread_start_us":270345,"threads_started":1,"wal-append.queue_time_us":319143}
W20260807 07:57:37.659089 976 log.cc:927] Time spent T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.113s user 0.000s sys 0.001s
W20260807 07:57:37.660614 963 log.cc:927] Time spent T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.144s user 0.000s sys 0.001s
W20260807 07:57:37.662577 973 log.cc:927] Time spent T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.119s user 0.001s sys 0.000s
I20260807 07:57:37.664746 30539 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:37.666244 939 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 07:57:37.667616 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:37.672369 30366 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.668668 908 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:37.683296 527 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.685461 30478 raft_consensus.cc:1275] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:37.686879 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:37.686798 30490 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260807 07:57:37.691836 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 100427us
I20260807 07:57:37.692447 30366 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:37.694149 30490 raft_consensus.cc:1240] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:37.695382 30588 raft_consensus.cc:2393] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 5: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:57:37.696287 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:37.700358 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:37.700986 30477 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:37.726550 30586 raft_consensus.cc:1240] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6. Ops: []
I20260807 07:57:37.726729 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:37.727434 30584 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:37.761777 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:57:37.762835 974 log.cc:927] Time spent T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.098s user 0.000s sys 0.000s
I20260807 07:57:37.765448 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:37.766054 30489 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:37.691433 954 consensus_queue.cc:237] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.779759 30488 raft_consensus.cc:1275] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:37.782608 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:37.783622 30487 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
W20260807 07:57:37.785527 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:37.795486 30584 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:37.802052 948 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:37.805934 30478 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:37.806890 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:37.807440 30478 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:37.807484 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:37.808734 948 consensus_queue.cc:1048] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:37.809449 30476 raft_consensus.cc:1240] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 1. Current term is 2. Ops: []
W20260807 07:57:37.810195 977 log.cc:927] Time spent T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.113s user 0.000s sys 0.000s
I20260807 07:57:37.810659 948 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:37.811106 945 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:37.811455 948 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.813575 948 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:37.818313 30489 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:37.818969 30480 raft_consensus.cc:1240] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6. Ops: []
I20260807 07:57:37.820993 30539 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:37.822121 30477 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:37.808815 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:37.827102 30490 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:37.839792 828 consensus_queue.cc:1059] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:37.807720 908 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:37.830892 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 215764us
I20260807 07:57:37.845096 30367 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:37.847013 30317 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:37.851670 908 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:37.830256 945 raft_consensus.cc:2749] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:57:37.878196 30539 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:37.878769 928 raft_consensus.cc:3055] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:37.879106 928 raft_consensus.cc:740] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:37.879858 928 consensus_queue.cc:260] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.880977 928 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:37.879879 625 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:37.861181 861 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:37.893963 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:37.896442 30358 raft_consensus.cc:2393] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 7: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:37.898028 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:37.904223 828 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:37.908921 30539 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:37.878521 945 consensus_queue.cc:1048] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260807 07:57:37.912581 945 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:57:37.916160 861 raft_consensus.cc:697] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:37.915241 30539 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:37.923977 30539 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:37.921766 948 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:57:37.926452 948 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:37.926834 948 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:37.930120 527 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:37.923699 374 consensus_queue.cc:1059] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260807 07:57:37.934612 374 raft_consensus.cc:3055] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:37.934993 374 raft_consensus.cc:740] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:37.935995 374 consensus_queue.cc:260] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.938282 374 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:37.938920 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:37.939711 30480 raft_consensus.cc:2393] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:37.940963 861 consensus_queue.cc:237] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.957310 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:37.957911 30487 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:37.961329 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:37.962062 30479 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:57:37.494692 30203 catalog_manager.cc:5028] TS b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): tablet 39d207f188764d0caf032e77702cdc6b (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
W20260807 07:57:37.974498 30203 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 479821us
W20260807 07:57:37.975767 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:37.973055 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:37.958814 954 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election won for term 6
W20260807 07:57:37.978662 967 log.cc:927] Time spent T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.388s user 0.003s sys 0.006s
I20260807 07:57:37.981135 30487 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
W20260807 07:57:37.984778 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 111685us
I20260807 07:57:37.988941 773 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:37.989500 773 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.991065 30221 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53656 (request call id 204) took 10313 ms. Trace:
I20260807 07:57:37.995428 954 raft_consensus.cc:697] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:37.996661 954 consensus_queue.cc:237] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:37.998170 30220 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40988 (request call id 45) took 2523 ms. Trace:
I20260807 07:57:37.991582 773 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:37.992838 30221 rpcz_store.cc:276] 0807 07:57:27.677651 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:27.677841 (+ 190us) service_pool.cc:224] Handling call
0807 07:57:37.990973 (+10313132us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:35.813893 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:35.818788 (+ 4895us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:35.818842 (+ 54us) write_op.cc:435] Acquired schema lock
0807 07:57:35.818869 (+ 27us) tablet.cc:662] Decoding operations
0807 07:57:35.822818 (+ 3949us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:35.830577 (+ 7759us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:35.833180 (+ 2603us) tablet.cc:685] Acquiring locks for 2 operations
0807 07:57:35.848019 (+ 14839us) tablet.cc:701] Row locks acquired
0807 07:57:35.848035 (+ 16us) write_op.cc:260] PREPARE: finished
0807 07:57:35.848203 (+ 168us) write_op.cc:270] Start()
0807 07:57:35.848366 (+ 163us) write_op.cc:276] Timestamp: P: 1786089455848146 usec, L: 0
0807 07:57:35.848384 (+ 18us) op_driver.cc:348] REPLICATION: starting
0807 07:57:35.849114 (+ 730us) log.cc:844] Serialized 928 byte log entry
0807 07:57:36.331625 (+482511us) op_driver.cc:464] REPLICATION: finished
0807 07:57:36.528000 (+196375us) write_op.cc:301] APPLY: starting
0807 07:57:36.528105 (+ 105us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:36.528244 (+ 139us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:36.528384 (+ 140us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:36.575457 (+ 47073us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:36.576339 (+ 882us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 07:57:36.576397 (+ 58us) write_op.cc:312] APPLY: finished
0807 07:57:36.576677 (+ 280us) log.cc:844] Serialized 28 byte log entry
0807 07:57:36.576861 (+ 184us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:36.576947 (+ 86us) write_op.cc:454] Released schema lock
0807 07:57:36.577001 (+ 54us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:36.577372 (+ 371us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:36.577418 (+ 46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":775261,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":192664,"apply.run_cpu_time_us":2339,"apply.run_wall_time_us":49357,"num_ops":2,"prepare.queue_time_us":142950,"prepare.run_cpu_time_us":30543,"prepare.run_wall_time_us":150515,"raft.queue_time_us":358426,"raft.run_cpu_time_us":69954,"raft.run_wall_time_us":255822,"replication_time_us":483036,"thread_start_us":351947,"threads_started":5,"wal-append.queue_time_us":199646}]]}
I20260807 07:57:37.991576 30365 raft_consensus.cc:1275] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:37.999301 30429 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:38.000420 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:38.003337 30584 raft_consensus.cc:2368] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5.
I20260807 07:57:38.006261 32376 raft_consensus.cc:2764] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260807 07:57:38.023265 30564 tablet_service.cc:1558] Processing DeleteTablet for tablet d30d61dc67614c5c9d0f1083e2a463b9 with delete_type TABLET_DATA_TOMBSTONED (TS f831a53ec51d452398015797d543164e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:34588
I20260807 07:57:38.027701 30320 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:38.034457 948 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.015640 30223 catalog_manager.cc:5697] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 5, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 5 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:38.038326 30223 catalog_manager.cc:5697] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 5 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:38.040089 30223 catalog_manager.cc:5697] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 4, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 4 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:38.042018 30539 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:38.044826 30223 catalog_manager.cc:5697] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 5, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:37.998564 30220 rpcz_store.cc:276] 0807 07:57:35.474841 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:35.481658 (+ 6817us) service_pool.cc:224] Handling call
0807 07:57:37.998087 (+2516429us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:37.085926 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:37.194312 (+108386us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:37.194350 (+ 38us) write_op.cc:435] Acquired schema lock
0807 07:57:37.194362 (+ 12us) tablet.cc:662] Decoding operations
0807 07:57:37.194836 (+ 474us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:37.194897 (+ 61us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:37.194923 (+ 26us) tablet.cc:685] Acquiring locks for 2 operations
0807 07:57:37.195230 (+ 307us) tablet.cc:701] Row locks acquired
0807 07:57:37.195248 (+ 18us) write_op.cc:260] PREPARE: finished
0807 07:57:37.195402 (+ 154us) write_op.cc:270] Start()
0807 07:57:37.195517 (+ 115us) write_op.cc:276] Timestamp: P: 1786089457195359 usec, L: 0
0807 07:57:37.195551 (+ 34us) op_driver.cc:348] REPLICATION: starting
0807 07:57:37.197004 (+ 1453us) log.cc:844] Serialized 918 byte log entry
0807 07:57:37.282454 (+ 85450us) op_driver.cc:464] REPLICATION: finished
0807 07:57:37.407888 (+125434us) write_op.cc:301] APPLY: starting
0807 07:57:37.407979 (+ 91us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:37.408092 (+ 113us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:37.408204 (+ 112us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:37.408559 (+ 355us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:37.408734 (+ 175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 07:57:37.408776 (+ 42us) write_op.cc:312] APPLY: finished
0807 07:57:37.408960 (+ 184us) log.cc:844] Serialized 28 byte log entry
0807 07:57:37.409126 (+ 166us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:37.409215 (+ 89us) write_op.cc:454] Released schema lock
0807 07:57:37.409253 (+ 38us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:37.409656 (+ 403us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:37.409687 (+ 31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":615972,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":114904,"apply.run_cpu_time_us":1746,"apply.run_wall_time_us":1746,"num_ops":2,"prepare.queue_time_us":397087,"prepare.run_cpu_time_us":3470,"prepare.run_wall_time_us":125458,"replication_time_us":86763,"thread_start_us":360603,"threads_started":2}]]}
I20260807 07:57:38.054551 30223 catalog_manager.cc:5697] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 4 to 5, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:38.056180 30223 catalog_manager.cc:5697] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 4, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 4 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:38.057526 30223 catalog_manager.cc:5697] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 4 to 5, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:38.049247 934 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:57:38.087656 992 log.cc:927] Time spent T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.051s user 0.000s sys 0.008s
I20260807 07:57:38.090895 30459 tablet_service.cc:1558] Processing DeleteTablet for tablet 14880a591ef44360b5046f67cab3d4ad with delete_type TABLET_DATA_TOMBSTONED (TS ef1ca7acf52a438f89f14707e9e06818 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33906
I20260807 07:57:38.046695 770 raft_consensus.cc:2749] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:38.111270 948 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:38.100281 30223 catalog_manager.cc:5697] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:38.112973 1003 tablet_replica.cc:333] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e: stopping tablet replica
I20260807 07:57:38.113258 30223 catalog_manager.cc:5697] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 2, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 2 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:38.114916 1003 raft_consensus.cc:2243] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 07:57:38.097723 885 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:38.119591 885 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.121321 885 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:38.098201 934 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.114997 30223 catalog_manager.cc:5697] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
W20260807 07:57:38.134829 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 92891.4us
I20260807 07:57:38.135186 30223 catalog_manager.cc:5697] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:38.137235 30223 catalog_manager.cc:5697] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 4, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:38.139266 30223 catalog_manager.cc:5697] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 2, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 2 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:38.140846 30223 catalog_manager.cc:5697] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 4, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 4 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:38.142509 30223 catalog_manager.cc:5697] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 5 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:38.143455 934 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:38.144309 30223 catalog_manager.cc:5697] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 2 to 5, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:38.146289 30223 catalog_manager.cc:5697] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:38.148213 30223 catalog_manager.cc:5697] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:38.149534 587 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:38.150028 587 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.149858 30223 catalog_manager.cc:5697] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 5 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:38.152217 587 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:38.151537 30223 catalog_manager.cc:5697] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:38.153641 30223 catalog_manager.cc:5697] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 4 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:38.160365 30482 raft_consensus.cc:1275] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:38.161057 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:38.161695 30478 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
W20260807 07:57:38.160084 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 50349.2us
I20260807 07:57:38.163609 403 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:57:38.164034 403 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:38.164388 403 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:38.163532 1003 raft_consensus.cc:2272] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:57:38.166115 30539 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:38.167271 30539 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:38.168521 927 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:57:38.169183 927 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:38.169643 927 raft_consensus.cc:697] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:38.170429 927 consensus_queue.cc:237] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.175920 30584 raft_consensus.cc:1275] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:38.179513 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:38.173981 30317 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:38.183525 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:38.175298 1012 tablet_replica.cc:333] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818: stopping tablet replica
I20260807 07:57:38.187719 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:57:38.188759 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 189515us
I20260807 07:57:38.190279 30367 raft_consensus.cc:2393] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 6: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:38.191896 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:38.192492 30367 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:57:38.192811 30364 raft_consensus.cc:1275] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:38.193605 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:38.194211 30579 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:38.194594 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:38.191026 30320 leader_election.cc:400] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5.
I20260807 07:57:38.197036 30579 raft_consensus.cc:1275] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:38.197363 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:38.198886 30585 raft_consensus.cc:1275] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:38.196287 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:38.200659 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:38.202005 32376 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:38.196413 30320 leader_election.cc:403] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260807 07:57:38.202426 32376 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:38.215435 981 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:38.198828 770 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:57:38.217674 770 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:38.218007 770 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:38.198705 819 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:57:38.221789 819 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.223804 819 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:38.230429 30476 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:38.241321 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:38.182762 937 consensus_queue.cc:1048] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
W20260807 07:57:38.244283 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 47072.8us
I20260807 07:57:38.234331 948 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:38.200673 773 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260807 07:57:38.260687 32376 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:38.242722 819 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:57:38.253739 1003 ts_tablet_manager.cc:1916] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:57:38.272316 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:57:38.275651 819 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.285743 30429 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:38.291706 30539 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:38.294306 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:38.302474 828 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:38.255559 948 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.311187 819 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:38.309556 828 raft_consensus.cc:697] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:38.315186 948 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:38.315246 828 consensus_queue.cc:237] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.312311 981 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 4. Current term is 5.
I20260807 07:57:38.316780 403 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.317857 30586 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:57:38.318842 403 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:38.322243 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:38.311677 30429 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:38.323642 658 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:57:38.327406 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:38.328130 30488 raft_consensus.cc:2393] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 7: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:38.328929 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:38.298236 770 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.331547 770 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:38.335173 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:38.335711 30478 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:38.304276 615 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:57:38.343268 30478 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:57:38.307822 1001 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260807 07:57:38.346396 30317 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:38.347245 937 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:57:38.347762 937 raft_consensus.cc:697] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:38.348613 937 consensus_queue.cc:237] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.350426 615 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:57:38.350835 615 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:38.350906 608 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260807 07:57:38.359952 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 92574.6us
I20260807 07:57:38.360983 30541 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:38.370034 527 raft_consensus.cc:2749] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:38.377635 30429 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:57:38.382068 987 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:57:38.387718 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:38.388809 30360 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:38.387094 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:38.393648 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:38.394341 30367 raft_consensus.cc:2393] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 7: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:57:38.395697 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:57:38.398000 30478 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:38.400818 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:38.401329 30588 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 8
I20260807 07:57:38.394255 1002 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260807 07:57:38.394366 638 consensus_queue.cc:1048] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260807 07:57:38.414351 939 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:38.429260 30588 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:57:38.431749 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:38.431960 1012 raft_consensus.cc:2243] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 07:57:38.432838 1012 raft_consensus.cc:2272] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:57:38.439258 30477 raft_consensus.cc:1275] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:38.429524 615 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.446488 615 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:38.447237 30476 raft_consensus.cc:2368] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 7. Current term is 8.
I20260807 07:57:38.446508 1003 ts_tablet_manager.cc:1929] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.4
I20260807 07:57:38.448086 1003 log.cc:1199] T d30d61dc67614c5c9d0f1083e2a463b9 P f831a53ec51d452398015797d543164e: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root/wals/d30d61dc67614c5c9d0f1083e2a463b9
I20260807 07:57:38.450713 30539 leader_election.cc:400] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 7. Current term is 8.
I20260807 07:57:38.451009 30539 leader_election.cc:403] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260807 07:57:38.451110 30203 catalog_manager.cc:5028] TS f831a53ec51d452398015797d543164e (127.27.64.131:33207): tablet d30d61dc67614c5c9d0f1083e2a463b9 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:57:38.452350 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:38.452926 30369 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:38.459019 1012 ts_tablet_manager.cc:1916] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:57:38.454682 770 consensus_queue.cc:1048] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260807 07:57:38.466223 697 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:38.481060 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:38.484573 30369 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:57:38.485759 30429 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:38.490869 1001 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:57:38.527227 1001 raft_consensus.cc:697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:38.542193 697 raft_consensus.cc:2749] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 7. Current term is 8.
I20260807 07:57:38.545265 1001 consensus_queue.cc:237] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.555074 30541 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:38.559523 688 raft_consensus.cc:2749] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:57:38.563180 403 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:38.561929 30541 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:38.568851 30581 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:57:38.574086 403 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 07:57:38.578775 1026 log.cc:927] Time spent T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.089s user 0.002s sys 0.000s
I20260807 07:57:38.576325 30541 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:57:38.633903 1035 log.cc:927] Time spent T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
I20260807 07:57:38.637724 1012 ts_tablet_manager.cc:1929] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.4
I20260807 07:57:38.638236 1012 log.cc:1199] T 14880a591ef44360b5046f67cab3d4ad P ef1ca7acf52a438f89f14707e9e06818: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root/wals/14880a591ef44360b5046f67cab3d4ad
I20260807 07:57:38.646509 30364 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260807 07:57:38.646912 30364 pending_rounds.cc:85] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19: Aborting all ops after (but not including) 3
I20260807 07:57:38.647115 30364 pending_rounds.cc:107] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260807 07:57:38.647322 30364 raft_consensus.cc:2889] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:57:38.601675 828 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:57:38.670097 30476 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:38.673609 30588 raft_consensus.cc:1275] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:38.686368 1019 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260807 07:57:38.693688 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 66284.4us
I20260807 07:57:38.700866 943 consensus_queue.cc:1048] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260807 07:57:38.692327 885 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260807 07:57:38.712102 30201 catalog_manager.cc:5028] TS ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): tablet 14880a591ef44360b5046f67cab3d4ad (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
W20260807 07:57:38.723677 1042 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4: Append to log took a long time: real 0.097s user 0.002s sys 0.000s
I20260807 07:57:38.775544 30488 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:38.781121 697 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:38.758535 1052 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:57:38.805905 1052 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:38.819576 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:38.820456 30476 raft_consensus.cc:2410] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260807 07:57:38.824450 30366 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:38.830088 30366 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:38.831873 1052 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:38.838034 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:38.838182 886 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:38.840416 886 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:38.844264 30320 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:57:38.859974 30488 raft_consensus.cc:1275] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 07:57:38.862872 587 consensus_queue.cc:1048] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260807 07:57:38.927918 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 52026.5us
W20260807 07:57:38.929504 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 53831.3us
I20260807 07:57:38.937750 30476 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:38.940584 1019 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:38.953531 908 raft_consensus.cc:2749] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 07:57:38.981294 1062 log.cc:927] Time spent T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.052s user 0.000s sys 0.001s
I20260807 07:57:38.996773 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:39.014163 30581 raft_consensus.cc:1275] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 07:57:39.024428 374 consensus_queue.cc:1048] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:39.075973 30488 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:39.076504 30488 raft_consensus.cc:606] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:39.076766 30488 raft_consensus.cc:614] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 07:57:39.078281 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 0a83ce36401344a4bb739af7bc87033e (from ef1ca7acf52a438f89f14707e9e06818 to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:39.079952 30579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:39.080399 30579 raft_consensus.cc:606] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:39.080646 30579 raft_consensus.cc:614] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 07:57:39.081555 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 1c3e02cee5d54a65bd61ae2521a9944c (from f831a53ec51d452398015797d543164e to ef1ca7acf52a438f89f14707e9e06818) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:39.083067 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:39.083490 30476 raft_consensus.cc:606] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:39.083742 30476 raft_consensus.cc:614] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 07:57:39.084503 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 42f1efe3594f411d9ed19ae2875c1bf0 (from ef1ca7acf52a438f89f14707e9e06818 to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:39.086279 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:39.086722 30476 raft_consensus.cc:606] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:39.086988 30476 raft_consensus.cc:614] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 07:57:39.087973 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 78ad63a77c6546d6bc5db4234526fc78 (from ef1ca7acf52a438f89f14707e9e06818 to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:39.089656 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f2551f38a348389729e12d49142027"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:39.090071 30476 raft_consensus.cc:606] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:39.090366 30476 raft_consensus.cc:614] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 07:57:39.104308 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet c8f2551f38a348389729e12d49142027 (from ef1ca7acf52a438f89f14707e9e06818 to b1188d7d3a0b455894bc443d571f6a19) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:57:39.104912 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260807 07:57:39.109680 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:39.110442 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:39.126418 30223 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53640 (request call id 175) took 2564 ms. Trace:
I20260807 07:57:39.126891 30223 rpcz_store.cc:276] 0807 07:57:36.562355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:36.562549 (+ 194us) service_pool.cc:224] Handling call
0807 07:57:39.126357 (+2563808us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:38.455566 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:38.470269 (+ 14703us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:38.470299 (+ 30us) write_op.cc:435] Acquired schema lock
0807 07:57:38.470318 (+ 19us) tablet.cc:662] Decoding operations
0807 07:57:38.535354 (+ 65036us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:38.541284 (+ 5930us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:38.541329 (+ 45us) tablet.cc:685] Acquiring locks for 21 operations
0807 07:57:38.543488 (+ 2159us) tablet.cc:701] Row locks acquired
0807 07:57:38.543517 (+ 29us) write_op.cc:260] PREPARE: finished
0807 07:57:38.543652 (+ 135us) write_op.cc:270] Start()
0807 07:57:38.543768 (+ 116us) write_op.cc:276] Timestamp: P: 1786089458543609 usec, L: 0
0807 07:57:38.543786 (+ 18us) op_driver.cc:348] REPLICATION: starting
0807 07:57:38.545355 (+ 1569us) log.cc:844] Serialized 8301 byte log entry
0807 07:57:38.919166 (+373811us) op_driver.cc:464] REPLICATION: finished
0807 07:57:39.015706 (+ 96540us) write_op.cc:301] APPLY: starting
0807 07:57:39.015793 (+ 87us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:39.016175 (+ 382us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:39.016283 (+ 108us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:39.024088 (+ 7805us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:39.024353 (+ 265us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0807 07:57:39.024397 (+ 44us) write_op.cc:312] APPLY: finished
0807 07:57:39.044875 (+ 20478us) log.cc:844] Serialized 144 byte log entry
0807 07:57:39.048374 (+ 3499us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:39.050936 (+ 2562us) write_op.cc:454] Released schema lock
0807 07:57:39.051001 (+ 65us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:39.051365 (+ 364us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:39.051393 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":646,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":96280,"apply.run_cpu_time_us":4648,"apply.run_wall_time_us":35650,"num_ops":21,"prepare.queue_time_us":147323,"prepare.run_cpu_time_us":17560,"prepare.run_wall_time_us":120973,"raft.queue_time_us":122015,"raft.run_cpu_time_us":6210,"raft.run_wall_time_us":121280,"replication_time_us":317555,"thread_start_us":242194,"threads_started":4,"wal-append.queue_time_us":16425}]]}
W20260807 07:57:39.127987 30294 auto_rebalancer.cc:644] Failed to schedule move for tablet 78ad63a77c6546d6bc5db4234526fc78: Illegal state: Replica ef1ca7acf52a438f89f14707e9e06818 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
W20260807 07:57:39.141463 30294 auto_rebalancer.cc:644] Failed to schedule move for tablet 5df190e0d6d146e8a2f82d090c06ecdf: Illegal state: Replica ef1ca7acf52a438f89f14707e9e06818 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:39.146180 30365 consensus_queue.cc:237] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:39.146895 30579 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 07:57:39.147475 30220 catalog_manager.cc:5697] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 4 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:39.148942 1001 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:39.153752 30220 catalog_manager.cc:5697] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 4 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:39.173440 30220 catalog_manager.cc:5697] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 4 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:39.175259 30220 catalog_manager.cc:5697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 4 to 6, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:39.178452 30220 catalog_manager.cc:5697] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:39.180096 30220 catalog_manager.cc:5697] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:39.181631 30220 catalog_manager.cc:5697] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 4, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 4 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:39.186163 30369 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 07:57:39.185880 30220 catalog_manager.cc:5697] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 5, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 5 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:39.188859 30220 catalog_manager.cc:5697] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 4 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:39.191344 1001 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260807 07:57:39.215135 938 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:39.239840 30488 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:57:39.244545 30590 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:57:39.225775 938 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:39.252606 938 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:39.253284 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:57:39.254089 30488 raft_consensus.cc:2393] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 5: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:39.247859 374 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260807 07:57:39.260079 1052 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260807 07:57:39.267093 30323 consensus_peers.cc:597] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6f61d2b65b04216b54f6a2f8deadd0a. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:57:39.271153 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:57:39.271793 30590 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:39.272924 30320 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:39.278446 1052 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:57:39.278885 1052 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:57:39.279342 1052 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:39.291985 1052 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:39.294512 1052 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:39.295241 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:39.296036 30488 raft_consensus.cc:2393] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 5: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:57:39.308097 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:39.327250 30588 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:39.329571 30320 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:39.333029 374 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:39.333577 374 raft_consensus.cc:697] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:39.334511 374 consensus_queue.cc:237] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:39.341480 638 raft_consensus.cc:2955] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:39.344763 30488 raft_consensus.cc:2955] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:39.374583 30369 consensus_queue.cc:237] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:39.399999 30585 raft_consensus.cc:2955] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:39.420363 30220 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53660 (request call id 187) took 1162 ms. Trace:
I20260807 07:57:39.424577 30221 catalog_manager.cc:5697] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 5, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:39.433156 30585 raft_consensus.cc:1275] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:57:39.432941 30221 catalog_manager.cc:5697] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 1 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
W20260807 07:57:39.435710 30323 consensus_peers.cc:597] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15fa23df425445ce99709045bc6e9789. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:57:39.436342 374 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:39.431205 30220 rpcz_store.cc:276] 0807 07:57:38.258076 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:38.258380 (+ 304us) service_pool.cc:224] Handling call
0807 07:57:39.420271 (+1161891us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:39.320985 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:39.321552 (+ 567us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:39.321590 (+ 38us) write_op.cc:435] Acquired schema lock
0807 07:57:39.321611 (+ 21us) tablet.cc:662] Decoding operations
0807 07:57:39.323321 (+ 1710us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:39.327273 (+ 3952us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:39.329515 (+ 2242us) tablet.cc:685] Acquiring locks for 9 operations
0807 07:57:39.373881 (+ 44366us) tablet.cc:701] Row locks acquired
0807 07:57:39.373900 (+ 19us) write_op.cc:260] PREPARE: finished
0807 07:57:39.374037 (+ 137us) write_op.cc:270] Start()
0807 07:57:39.374157 (+ 120us) write_op.cc:276] Timestamp: P: 1786089459373995 usec, L: 0
0807 07:57:39.374179 (+ 22us) op_driver.cc:348] REPLICATION: starting
0807 07:57:39.374797 (+ 618us) log.cc:844] Serialized 3637 byte log entry
0807 07:57:39.376812 (+ 2015us) op_driver.cc:464] REPLICATION: finished
0807 07:57:39.377253 (+ 441us) write_op.cc:301] APPLY: starting
0807 07:57:39.377326 (+ 73us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:39.377561 (+ 235us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:39.377658 (+ 97us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:39.378574 (+ 916us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:39.378761 (+ 187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0807 07:57:39.378802 (+ 41us) write_op.cc:312] APPLY: finished
0807 07:57:39.379044 (+ 242us) log.cc:844] Serialized 70 byte log entry
0807 07:57:39.379201 (+ 157us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:39.379319 (+ 118us) write_op.cc:454] Released schema lock
0807 07:57:39.379372 (+ 53us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:39.379700 (+ 328us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:39.379725 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":239,"apply.run_cpu_time_us":2402,"apply.run_wall_time_us":2401,"num_ops":9,"prepare.queue_time_us":95605,"prepare.run_cpu_time_us":4252,"prepare.run_wall_time_us":54059,"replication_time_us":2502,"thread_start_us":93935,"threads_started":1}]]}
I20260807 07:57:39.466280 30488 raft_consensus.cc:1275] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:57:39.467933 374 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:39.467772 30223 catalog_manager.cc:5697] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:39.479168 30223 catalog_manager.cc:5697] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 2 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:39.482324 30223 catalog_manager.cc:5697] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 4, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 4 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:39.484828 30223 catalog_manager.cc:5697] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 2, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:39.486320 30223 catalog_manager.cc:5697] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:39.491958 30221 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53656 (request call id 205) took 1111 ms. Trace:
I20260807 07:57:39.493250 30223 catalog_manager.cc:5697] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:39.492390 30221 rpcz_store.cc:276] 0807 07:57:38.380528 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:57:38.380635 (+ 107us) service_pool.cc:224] Handling call
0807 07:57:39.491898 (+1111263us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:57:39.436445 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:57:39.436970 (+ 525us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:57:39.437000 (+ 30us) write_op.cc:435] Acquired schema lock
0807 07:57:39.437016 (+ 16us) tablet.cc:662] Decoding operations
0807 07:57:39.437423 (+ 407us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:57:39.437595 (+ 172us) write_op.cc:641] Partition lock acquired for write op
0807 07:57:39.437629 (+ 34us) tablet.cc:685] Acquiring locks for 2 operations
0807 07:57:39.437945 (+ 316us) tablet.cc:701] Row locks acquired
0807 07:57:39.437962 (+ 17us) write_op.cc:260] PREPARE: finished
0807 07:57:39.438094 (+ 132us) write_op.cc:270] Start()
0807 07:57:39.438198 (+ 104us) write_op.cc:276] Timestamp: P: 1786089459438055 usec, L: 0
0807 07:57:39.438216 (+ 18us) op_driver.cc:348] REPLICATION: starting
0807 07:57:39.438779 (+ 563us) log.cc:844] Serialized 928 byte log entry
0807 07:57:39.440516 (+ 1737us) op_driver.cc:464] REPLICATION: finished
0807 07:57:39.441213 (+ 697us) write_op.cc:301] APPLY: starting
0807 07:57:39.441295 (+ 82us) tablet.cc:1367] starting BulkCheckPresence
0807 07:57:39.441443 (+ 148us) tablet.cc:1370] finished BulkCheckPresence
0807 07:57:39.441540 (+ 97us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:57:39.441913 (+ 373us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:57:39.442085 (+ 172us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 07:57:39.442139 (+ 54us) write_op.cc:312] APPLY: finished
0807 07:57:39.442327 (+ 188us) log.cc:844] Serialized 28 byte log entry
0807 07:57:39.442484 (+ 157us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:39.442574 (+ 90us) write_op.cc:454] Released schema lock
0807 07:57:39.442611 (+ 37us) write_op.cc:341] FINISH: Updating metrics
0807 07:57:39.442936 (+ 325us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:57:39.442963 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5241,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":463,"apply.run_cpu_time_us":1694,"apply.run_wall_time_us":1694,"num_ops":2,"prepare.queue_time_us":107,"prepare.run_cpu_time_us":2500,"prepare.run_wall_time_us":2582,"replication_time_us":2197}]]}
I20260807 07:57:39.498198 937 raft_consensus.cc:2955] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:39.509568 30585 raft_consensus.cc:2955] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:39.525481 30488 raft_consensus.cc:2955] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:39.567565 30220 catalog_manager.cc:5697] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:39.571596 30220 catalog_manager.cc:5697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:39.635558 30222 catalog_manager.cc:5697] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:39.664655 30222 catalog_manager.cc:5697] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 4 to 5, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:39.715220 1090 ts_tablet_manager.cc:933] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:39.741677 1090 tablet_copy_client.cc:323] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:57:39.754209 30385 tablet_copy_service.cc:140] P b1188d7d3a0b455894bc443d571f6a19: Received BeginTabletCopySession request for tablet e6f61d2b65b04216b54f6a2f8deadd0a from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:33338)
I20260807 07:57:39.754830 30385 tablet_copy_service.cc:161] P b1188d7d3a0b455894bc443d571f6a19: Beginning new tablet copy session on tablet e6f61d2b65b04216b54f6a2f8deadd0a from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:33338: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-e6f61d2b65b04216b54f6a2f8deadd0a
I20260807 07:57:39.776883 30385 tablet_copy_source_session.cc:215] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:39.793677 1090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f61d2b65b04216b54f6a2f8deadd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:39.842270 30588 raft_consensus.cc:1275] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:39.844031 909 consensus_queue.cc:1048] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:39.890364 30488 raft_consensus.cc:1275] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:39.894732 909 consensus_queue.cc:1048] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:40.015343 1090 tablet_copy_client.cc:806] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:40.016031 1090 tablet_copy_client.cc:670] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:40.021318 1099 ts_tablet_manager.cc:933] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:40.068849 1090 tablet_copy_client.cc:538] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:40.102000 1099 tablet_copy_client.cc:323] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:57:40.103965 30385 tablet_copy_service.cc:140] P b1188d7d3a0b455894bc443d571f6a19: Received BeginTabletCopySession request for tablet 15fa23df425445ce99709045bc6e9789 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:33338)
I20260807 07:57:40.104518 30385 tablet_copy_service.cc:161] P b1188d7d3a0b455894bc443d571f6a19: Beginning new tablet copy session on tablet 15fa23df425445ce99709045bc6e9789 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:33338: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-15fa23df425445ce99709045bc6e9789
I20260807 07:57:40.118346 1090 tablet_bootstrap.cc:492] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:40.127053 30385 tablet_copy_source_session.cc:215] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:40.130955 1099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15fa23df425445ce99709045bc6e9789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:40.180225 1099 tablet_copy_client.cc:806] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:40.180784 1099 tablet_copy_client.cc:670] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:40.191007 1099 tablet_copy_client.cc:538] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:40.216603 1090 tablet_bootstrap.cc:492] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:40.222146 1090 tablet_bootstrap.cc:492] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:40.223026 1090 ts_tablet_manager.cc:1403] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.105s user 0.021s sys 0.011s
I20260807 07:57:40.220679 1099 tablet_bootstrap.cc:492] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:40.225211 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:40.260533 1090 raft_consensus.cc:359] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:40.269557 1090 raft_consensus.cc:740] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:40.270164 1090 consensus_queue.cc:260] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:40.272481 1090 ts_tablet_manager.cc:1434] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.049s user 0.000s sys 0.004s
I20260807 07:57:40.274991 30385 tablet_copy_service.cc:342] P b1188d7d3a0b455894bc443d571f6a19: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-e6f61d2b65b04216b54f6a2f8deadd0a received from {username='slave'} at 127.0.0.1:33338
I20260807 07:57:40.276292 30385 tablet_copy_service.cc:434] P b1188d7d3a0b455894bc443d571f6a19: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-e6f61d2b65b04216b54f6a2f8deadd0a on tablet e6f61d2b65b04216b54f6a2f8deadd0a with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:40.332857 1099 tablet_bootstrap.cc:492] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:40.333938 1099 tablet_bootstrap.cc:492] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:40.334739 1099 ts_tablet_manager.cc:1403] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.114s user 0.017s sys 0.016s
I20260807 07:57:40.350435 30588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:40.351069 30588 raft_consensus.cc:606] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 3 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:40.352483 1099 raft_consensus.cc:359] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:40.353325 1099 raft_consensus.cc:740] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:40.356832 1099 consensus_queue.cc:260] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:40.364465 1099 ts_tablet_manager.cc:1434] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260807 07:57:40.378942 30385 tablet_copy_service.cc:342] P b1188d7d3a0b455894bc443d571f6a19: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-15fa23df425445ce99709045bc6e9789 received from {username='slave'} at 127.0.0.1:33338
I20260807 07:57:40.382164 30385 tablet_copy_service.cc:434] P b1188d7d3a0b455894bc443d571f6a19: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-15fa23df425445ce99709045bc6e9789 on tablet 15fa23df425445ce99709045bc6e9789 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:40.557962 30369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:40.558594 30369 raft_consensus.cc:606] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:40.588065 30369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:40.588743 30369 raft_consensus.cc:606] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:40.600350 937 raft_consensus.cc:993] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:40.600951 1123 raft_consensus.cc:1081] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:40.602957 30363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37222025709f4384a02a9c633ee3190c"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:40.603569 30363 raft_consensus.cc:606] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:40.607182 30369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:40.607735 30369 raft_consensus.cc:606] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:40.610539 30488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:57:40.611110 30488 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:40.611430 30488 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:40.613107 30363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:40.616590 30363 raft_consensus.cc:606] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:40.617781 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260807 07:57:40.619431 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:40.620175 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:40.626509 31383 raft_consensus.cc:1217] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3] Dedup: 3.3->[]
I20260807 07:57:40.627590 30488 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.630069 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:40.630611 30363 raft_consensus.cc:3055] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:40.630867 30363 raft_consensus.cc:740] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:40.631546 30363 consensus_queue.cc:260] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.632578 30363 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
W20260807 07:57:40.632845 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 123320us
I20260807 07:57:40.651623 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:40.652235 30579 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:40.652156 30363 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:40.653863 30429 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:40.654959 937 raft_consensus.cc:993] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:40.656262 1002 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:40.656807 1002 raft_consensus.cc:697] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:40.658325 937 raft_consensus.cc:1081] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:40.659404 1002 consensus_queue.cc:237] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.660373 30579 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:40.662984 30477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:57:40.663480 30477 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:40.663827 30477 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:40.667222 31383 raft_consensus.cc:1217] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5] Dedup: 5.5->[]
I20260807 07:57:40.678128 1052 raft_consensus.cc:993] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:40.678604 1052 raft_consensus.cc:1081] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:40.680588 30476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:57:40.681080 30476 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:40.681425 30476 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:40.683228 697 raft_consensus.cc:993] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:40.683727 1122 raft_consensus.cc:1081] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 3 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:40.688405 30369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45054
I20260807 07:57:40.688910 30369 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:40.689211 30369 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:40.689800 30477 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.689503 30476 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.691931 30477 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:40.693728 30476 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:40.696442 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:40.696678 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:40.696995 30365 raft_consensus.cc:3055] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:40.697276 30366 raft_consensus.cc:3055] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:57:40.697324 30365 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:40.697702 30366 raft_consensus.cc:740] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:40.698627 30366 consensus_queue.cc:260] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.698565 30365 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.700127 30365 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:40.701591 30366 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:40.707600 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:40.708175 30579 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:40.708479 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:40.709039 30588 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:40.715091 30366 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:57:40.716564 30429 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:40.717321 1120 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:57:40.718036 1120 raft_consensus.cc:697] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:40.718731 30588 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:57:40.718865 1120 consensus_queue.cc:237] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.728304 30365 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:40.729585 30429 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:40.730592 1002 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:40.732278 30223 catalog_manager.cc:5697] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 4 to 5, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:40.736056 374 raft_consensus.cc:993] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:40.736567 1052 raft_consensus.cc:1081] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:40.731292 1002 raft_consensus.cc:697] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:40.738363 30480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:57:40.738785 30480 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:40.739053 30480 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:57:40.741763 1002 consensus_queue.cc:237] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.742811 30369 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.744666 30369 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:40.745435 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:40.746061 30476 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:40.748167 30480 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.652390 30488 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:40.754027 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:40.754556 30585 raft_consensus.cc:3055] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:40.754839 30585 raft_consensus.cc:740] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:40.755533 30585 consensus_queue.cc:260] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.756572 30585 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:40.757844 30476 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:40.759092 30317 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:40.759984 1052 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:40.760540 1052 raft_consensus.cc:697] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:40.761390 1052 consensus_queue.cc:237] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.763121 30579 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:40.760094 30480 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:40.770396 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:40.793123 30363 raft_consensus.cc:3055] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:57:40.793463 30363 raft_consensus.cc:740] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:40.794167 30363 consensus_queue.cc:260] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.795368 30363 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:57:40.766894 30585 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:57:40.778784 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:40.797595 30588 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:57:40.803148 30363 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 9.
I20260807 07:57:40.804111 30429 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:40.806761 30588 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 9.
I20260807 07:57:40.807570 1120 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 07:57:40.808115 1120 raft_consensus.cc:697] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:40.808915 1120 consensus_queue.cc:237] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.840310 30222 catalog_manager.cc:5697] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 4 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:40.937044 1052 raft_consensus.cc:993] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:40.937558 1052 raft_consensus.cc:1081] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:40.941048 30477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37222025709f4384a02a9c633ee3190c"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:57:40.941613 30477 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:40.941964 30477 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:40.947971 30223 catalog_manager.cc:5697] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 8 to 9, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 9 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:40.962316 937 raft_consensus.cc:1064] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:40.970782 30223 catalog_manager.cc:5697] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 6 to 7, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:40.964968 937 consensus_queue.cc:237] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:40.972381 30223 catalog_manager.cc:5697] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 5 to 6, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:40.983526 30477 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.991421 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:40.992084 30366 raft_consensus.cc:3055] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:40.992790 30366 raft_consensus.cc:740] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:40.993566 30366 consensus_queue.cc:260] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:40.994771 30366 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:40.998287 30477 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:41.000185 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:41.000715 30588 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:41.008035 30366 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:41.009204 30429 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:41.010493 1002 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:41.011006 1002 raft_consensus.cc:697] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:41.011833 1002 consensus_queue.cc:237] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:41.018285 30588 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:41.076181 30223 catalog_manager.cc:5697] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 5 to 6, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:41.082749 31383 raft_consensus.cc:1275] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 07:57:41.087858 30579 raft_consensus.cc:1275] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 07:57:41.092109 1052 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:41.100378 30477 raft_consensus.cc:1275] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 07:57:41.102099 937 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:41.111685 1123 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:41.131990 30366 raft_consensus.cc:1275] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:41.134415 1120 consensus_queue.cc:1048] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:41.145560 1123 raft_consensus.cc:1064] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:41.148265 1123 consensus_queue.cc:237] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:41.160727 556 raft_consensus.cc:2955] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:41.167500 30588 raft_consensus.cc:1275] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:41.167192 30480 raft_consensus.cc:2955] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:41.170652 1002 consensus_queue.cc:1048] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:41.196225 30222 catalog_manager.cc:5697] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:41.206885 31382 raft_consensus.cc:2955] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:41.211473 30363 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:41.212736 31383 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:57:41.214463 30480 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:57:41.214960 30585 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:57:41.215883 937 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:41.216982 1115 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:41.221443 1052 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:41.229491 30585 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:41.250759 30476 raft_consensus.cc:1275] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:41.252249 556 consensus_queue.cc:1048] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:41.266916 30585 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:41.294193 1121 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260807 07:57:41.282784 1120 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260807 07:57:41.321026 1155 log.cc:927] Time spent T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.119s user 0.001s sys 0.000s
W20260807 07:57:41.348881 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 66780.6us
W20260807 07:57:41.412588 1160 log.cc:927] Time spent T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.074s user 0.000s sys 0.001s
I20260807 07:57:41.402726 374 raft_consensus.cc:2955] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:41.406383 658 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260807 07:57:41.426164 1169 log.cc:927] Time spent T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
W20260807 07:57:41.458132 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 129207us
W20260807 07:57:41.459180 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 84615.6us
I20260807 07:57:41.467988 30366 consensus_queue.cc:237] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:41.473903 31383 raft_consensus.cc:1275] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:41.475749 1123 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:41.484331 31383 raft_consensus.cc:2955] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:41.512404 937 raft_consensus.cc:2955] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:41.624207 30587 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:41.605623 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 15fa23df425445ce99709045bc6e9789 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:57:41.602106 30584 raft_consensus.cc:2955] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:41.609881 30578 raft_consensus.cc:1275] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 07:57:41.531123 30588 raft_consensus.cc:2955] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:57:41.679167 30203 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 73563.7us
I20260807 07:57:41.534942 30579 raft_consensus.cc:1275] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 07:57:41.517396 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 62038.1us
I20260807 07:57:41.568413 30365 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:41.529531 30364 raft_consensus.cc:1275] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 07:57:41.555346 30223 catalog_manager.cc:5697] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:41.548405 31382 raft_consensus.cc:2955] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:41.691648 30585 raft_consensus.cc:1275] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:41.696031 30488 raft_consensus.cc:2955] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:41.609066 30369 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260807 07:57:41.760648 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 43935.7us
I20260807 07:57:41.746941 1171 consensus_queue.cc:1048] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260807 07:57:41.761610 1187 consensus_queue.cc:1048] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:41.763465 1052 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:41.765520 1173 consensus_queue.cc:1048] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:41.747684 1002 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260807 07:57:41.745718 1185 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260807 07:57:41.807179 30586 raft_consensus.cc:2955] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:57:41.811774 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 64351.5us
I20260807 07:57:41.827064 1185 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
W20260807 07:57:41.935179 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 111110us
I20260807 07:57:42.027092 30221 catalog_manager.cc:5697] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index 4 to 5, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:57:42.037415 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:42.068794 30459 tablet_service.cc:1558] Processing DeleteTablet for tablet 15fa23df425445ce99709045bc6e9789 with delete_type TABLET_DATA_TOMBSTONED (TS ef1ca7acf52a438f89f14707e9e06818 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33906
I20260807 07:57:42.084892 30364 consensus_queue.cc:237] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:42.103878 31382 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:57:42.105695 1186 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:57:42.110163 30488 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:57:42.112761 1211 tablet_replica.cc:333] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818: stopping tablet replica
I20260807 07:57:42.113250 1184 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:57:42.113871 1211 raft_consensus.cc:2243] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 07:57:42.117092 1211 raft_consensus.cc:2272] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:57:42.127585 30477 raft_consensus.cc:2955] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:42.129664 31383 raft_consensus.cc:2955] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:42.125007 1123 raft_consensus.cc:2955] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:42.144165 1211 ts_tablet_manager.cc:1916] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:57:42.171548 30220 catalog_manager.cc:5697] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 6 to 7, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:42.195879 30564 tablet_service.cc:1558] Processing DeleteTablet for tablet e6f61d2b65b04216b54f6a2f8deadd0a with delete_type TABLET_DATA_TOMBSTONED (TS f831a53ec51d452398015797d543164e not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34588
I20260807 07:57:42.197558 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e6f61d2b65b04216b54f6a2f8deadd0a with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:57:42.269973 1212 tablet_replica.cc:333] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e: stopping tablet replica
I20260807 07:57:42.276309 1212 raft_consensus.cc:2243] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 07:57:42.277225 1212 raft_consensus.cc:2272] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 07:57:42.283655 1212 ts_tablet_manager.cc:1916] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:57:42.297479 1211 ts_tablet_manager.cc:1929] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260807 07:57:42.297986 1211 log.cc:1199] T 15fa23df425445ce99709045bc6e9789 P ef1ca7acf52a438f89f14707e9e06818: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root/wals/15fa23df425445ce99709045bc6e9789
I20260807 07:57:42.299597 30201 catalog_manager.cc:5028] TS ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): tablet 15fa23df425445ce99709045bc6e9789 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:57:42.304517 30588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:42.305096 30588 raft_consensus.cc:606] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:42.310084 30588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:42.310602 30588 raft_consensus.cc:606] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:42.325496 30364 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:42.327423 30364 raft_consensus.cc:606] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:42.330338 30588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:42.330893 30588 raft_consensus.cc:606] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:42.333630 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:42.334154 30477 raft_consensus.cc:606] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:42.340906 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 07:57:42.343328 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:42.344038 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:42.364475 1212 ts_tablet_manager.cc:1929] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260807 07:57:42.369557 1212 log.cc:1199] T e6f61d2b65b04216b54f6a2f8deadd0a P f831a53ec51d452398015797d543164e: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root/wals/e6f61d2b65b04216b54f6a2f8deadd0a
I20260807 07:57:42.390538 30203 catalog_manager.cc:5028] TS f831a53ec51d452398015797d543164e (127.27.64.131:33207): tablet e6f61d2b65b04216b54f6a2f8deadd0a (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:57:42.566601 1179 raft_consensus.cc:993] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:42.567154 1179 raft_consensus.cc:1081] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:42.568823 30369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45054
I20260807 07:57:42.569360 30369 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:42.569715 30369 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:42.632704 30369 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:42.637158 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:42.637805 30480 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:42.646925 30369 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:42.648692 30480 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:42.649668 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:42.650259 30588 raft_consensus.cc:3055] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:42.650151 30317 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:42.650653 30588 raft_consensus.cc:740] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:42.651312 30588 consensus_queue.cc:260] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:42.653395 1184 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:42.654016 1184 raft_consensus.cc:697] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:42.654904 1184 consensus_queue.cc:237] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:42.663651 30588 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:42.671375 30588 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:42.701506 30221 catalog_manager.cc:5697] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 4 to 5, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:42.715653 1180 raft_consensus.cc:993] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:42.716300 1179 raft_consensus.cc:1081] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:42.718781 30477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:57:42.719318 30477 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:42.719653 30477 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:42.744731 30477 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:42.752732 30477 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:42.753713 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:42.755738 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:42.756471 30585 raft_consensus.cc:3055] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:42.761034 30585 raft_consensus.cc:740] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:42.761978 30585 consensus_queue.cc:260] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:42.763342 30585 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:42.771813 30369 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:42.778772 1179 raft_consensus.cc:993] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:42.779289 1179 raft_consensus.cc:1081] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:42.798897 30585 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:42.803188 30369 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:42.820933 30477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:57:42.821693 30477 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:42.822072 30477 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:42.833709 30477 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:42.835718 30429 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:42.838439 1173 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:42.839020 1173 raft_consensus.cc:697] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:42.839825 1173 consensus_queue.cc:237] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:42.840626 1184 raft_consensus.cc:993] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:42.841090 1184 raft_consensus.cc:1081] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:42.842994 30488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:57:42.843502 30488 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:42.843827 30488 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:42.857607 30488 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:42.858120 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:42.858726 30363 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:42.861325 30488 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:42.862052 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:42.862699 30369 raft_consensus.cc:3055] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:42.862980 30369 raft_consensus.cc:740] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:42.863720 30369 consensus_queue.cc:260] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:42.864090 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:42.864656 31383 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:42.864939 30369 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:42.872429 30369 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:42.872991 31383 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:42.883374 30429 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:42.884433 1121 raft_consensus.cc:2804] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:42.872582 30363 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:57:42.890295 30429 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:42.891008 1173 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:57:42.891518 1173 raft_consensus.cc:697] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:42.892390 1173 consensus_queue.cc:237] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:42.878721 30477 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:42.905321 1121 raft_consensus.cc:697] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:42.906376 1121 consensus_queue.cc:237] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:42.909647 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:42.910220 30588 raft_consensus.cc:3055] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:57:42.910509 30588 raft_consensus.cc:740] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:42.911317 30588 consensus_queue.cc:260] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:42.912458 30588 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:42.921356 30588 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:57:42.931490 30220 catalog_manager.cc:5697] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 3 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:42.949851 1121 raft_consensus.cc:993] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:42.950436 1228 raft_consensus.cc:1081] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:42.955313 30363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:42.955914 30363 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:42.956326 30363 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:42.963969 30363 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:42.971930 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:42.972088 30363 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:42.972515 30477 raft_consensus.cc:3055] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:57:42.972894 30477 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:42.973615 30477 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:42.974659 30477 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:42.982084 30477 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:57:42.983251 30317 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:42.984143 1123 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:57:42.984683 1123 raft_consensus.cc:697] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:42.986425 1123 consensus_queue.cc:237] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:42.989588 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 59057.2us
I20260807 07:57:42.994021 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:42.994529 30584 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:42.999913 30220 catalog_manager.cc:5697] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 4 to 5, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:43.001675 30220 catalog_manager.cc:5697] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 6 to 7, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:43.011723 30584 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:57:43.019102 30221 catalog_manager.cc:5697] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 6 to 7, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:43.157815 30584 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:43.159597 1123 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:43.261322 30480 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260807 07:57:43.263605 1184 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:43.393299 30364 raft_consensus.cc:1275] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:43.395181 30363 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:57:43.397178 1226 consensus_queue.cc:1048] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:43.398574 1226 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:43.416890 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
W20260807 07:57:43.434610 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 55080.8us
I20260807 07:57:43.461534 30369 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:43.467972 1173 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260807 07:57:43.472893 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 105694us
I20260807 07:57:43.482888 30360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15fa23df425445ce99709045bc6e9789"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:43.483479 30360 raft_consensus.cc:606] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:57:43.485601 30584 raft_consensus.cc:1275] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:43.503499 30586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:43.504179 30586 raft_consensus.cc:606] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:43.524068 30586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:43.524873 30586 raft_consensus.cc:606] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
W20260807 07:57:43.545254 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 46235.2us
I20260807 07:57:43.549631 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:43.550220 30480 raft_consensus.cc:606] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:43.553565 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 07:57:43.555078 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:43.556433 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:43.563438 30586 consensus_queue.cc:237] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:43.568936 30477 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:57:43.588608 1052 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:43.593417 30585 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:57:43.556653 1173 consensus_queue.cc:1048] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260807 07:57:43.635820 30542 consensus_peers.cc:597] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 457aab41fd17414ab083fedaf23f3ff8. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:57:43.636646 31383 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260807 07:57:43.658957 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 58756.6us
W20260807 07:57:43.660866 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 72867.3us
W20260807 07:57:43.665877 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 58758us
I20260807 07:57:43.665789 30588 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:43.658386 1226 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260807 07:57:43.714565 30369 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:57:43.692031 1232 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260807 07:57:43.742138 30477 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:57:43.783308 1278 raft_consensus.cc:993] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:43.784734 1278 raft_consensus.cc:1081] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
W20260807 07:57:43.862443 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 169974us
I20260807 07:57:43.867808 1272 raft_consensus.cc:993] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:43.868896 1272 raft_consensus.cc:1081] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:43.871595 1228 raft_consensus.cc:993] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:43.872092 1228 raft_consensus.cc:1081] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
W20260807 07:57:43.889992 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 44709.6us
I20260807 07:57:43.891201 1268 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:43.900066 1258 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:43.903120 1296 raft_consensus.cc:993] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:43.903658 1296 raft_consensus.cc:1081] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:43.905923 30364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45054
I20260807 07:57:43.906548 30364 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:43.906911 30364 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:43.919446 30364 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:43.922235 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:43.922788 30478 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:43.924259 30360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:43.924803 30360 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:43.926056 30360 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:43.927834 30578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15fa23df425445ce99709045bc6e9789"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:57:43.928354 30578 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:43.928704 30578 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:43.934140 30360 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:43.936754 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:43.937322 30488 raft_consensus.cc:3055] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:43.937723 30488 raft_consensus.cc:740] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:43.938433 30488 consensus_queue.cc:260] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:43.939337 30477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:57:43.939877 30477 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:43.940222 30477 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:43.939308 30488 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:43.957626 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:43.958333 31382 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:43.957643 30477 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:43.975401 30477 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:43.936007 30360 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:43.982786 30478 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:57:43.984589 30578 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:43.992405 30317 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:43.993319 1297 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:57:43.994153 30578 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:43.995051 30364 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:43.995275 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:43.996474 1297 raft_consensus.cc:697] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:43.998168 1299 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:44.003472 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:43.979732 31382 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:44.106037 1297 consensus_queue.cc:237] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:44.032039 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:44.108780 31383 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:44.112550 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 69905.5us
I20260807 07:57:44.114938 30323 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
I20260807 07:57:43.990849 30488 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
W20260807 07:57:44.080989 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 107507us
I20260807 07:57:44.116539 30360 raft_consensus.cc:3055] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:44.116879 30360 raft_consensus.cc:740] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:44.117631 30360 consensus_queue.cc:260] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:44.076279 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 59373.1us
I20260807 07:57:44.118693 30360 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:44.004514 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:44.123214 1232 raft_consensus.cc:2804] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:44.131474 30480 raft_consensus.cc:1240] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 7. Current term is 8. Ops: []
I20260807 07:57:44.137928 30478 raft_consensus.cc:1240] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6. Ops: []
I20260807 07:57:44.108824 30585 raft_consensus.cc:3055] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:57:44.142835 1232 raft_consensus.cc:697] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:44.143345 30585 raft_consensus.cc:740] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:44.144711 1232 consensus_queue.cc:237] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:44.148458 30585 consensus_queue.cc:260] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:44.163971 30585 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:44.152544 31383 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:44.153812 1304 consensus_queue.cc:1059] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:44.166426 30542 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:44.167516 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:44.168046 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:44.169976 30364 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:44.174263 30360 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
W20260807 07:57:44.163964 1268 consensus_queue.cc:1175] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ef1ca7acf52a438f89f14707e9e06818" responder_term: 8 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 07:57:44.178510 1254 raft_consensus.cc:2955] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:44.180898 1278 raft_consensus.cc:2804] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:44.181468 1278 raft_consensus.cc:697] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:44.182379 1278 consensus_queue.cc:237] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:44.195055 30586 raft_consensus.cc:3055] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:44.195392 30364 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:44.196295 30586 raft_consensus.cc:740] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:44.197636 30586 consensus_queue.cc:260] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:44.201256 30586 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:44.202998 30429 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:44.207348 1273 raft_consensus.cc:2804] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:44.207901 1273 raft_consensus.cc:697] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:44.208801 1273 consensus_queue.cc:237] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:44.208446 30366 raft_consensus.cc:2955] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:44.213934 1316 ts_tablet_manager.cc:933] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:44.206898 30585 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:57:44.221205 30586 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
W20260807 07:57:44.225036 1304 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260807 07:57:44.258385 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 55707.2us
I20260807 07:57:44.264658 30364 raft_consensus.cc:1240] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 7. Current term is 8. Ops: []
I20260807 07:57:44.275941 30221 catalog_manager.cc:5697] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 7 to 8, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 8 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:44.276737 30220 catalog_manager.cc:5697] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 5 to 6, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:44.285581 30222 catalog_manager.cc:5697] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 4, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 4 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260807 07:57:44.295523 1313 log.cc:927] Time spent T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.089s user 0.000s sys 0.000s
I20260807 07:57:44.263208 30360 consensus_queue.cc:237] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:44.313318 30488 raft_consensus.cc:2955] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:44.340723 1316 tablet_copy_client.cc:323] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.131:33207
W20260807 07:57:44.342306 30323 consensus_peers.cc:597] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af8f2d95eba240e2965db9be8b951bee. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:57:44.346037 30586 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:44.345043 30488 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:44.348145 30605 tablet_copy_service.cc:140] P f831a53ec51d452398015797d543164e: Received BeginTabletCopySession request for tablet 457aab41fd17414ab083fedaf23f3ff8 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:42218)
I20260807 07:57:44.348088 1232 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:44.348783 30605 tablet_copy_service.cc:161] P f831a53ec51d452398015797d543164e: Beginning new tablet copy session on tablet 457aab41fd17414ab083fedaf23f3ff8 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:42218: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-457aab41fd17414ab083fedaf23f3ff8
I20260807 07:57:44.349402 1297 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:44.362154 30605 tablet_copy_source_session.cc:215] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:44.388335 1316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457aab41fd17414ab083fedaf23f3ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:44.426826 1052 raft_consensus.cc:2955] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:44.440402 30582 raft_consensus.cc:2955] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:44.441823 30480 raft_consensus.cc:2955] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:44.470386 30360 consensus_queue.cc:237] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:44.489624 1316 tablet_copy_client.cc:806] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:44.497848 1316 tablet_copy_client.cc:670] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:44.502419 1316 tablet_copy_client.cc:538] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:44.505698 30488 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260807 07:57:44.506932 30323 consensus_peers.cc:597] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2c57e3fb98348029b5e341d17d669bd. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:57:44.510401 1297 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260807 07:57:44.518968 30582 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:57:44.525203 1316 tablet_bootstrap.cc:492] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:44.526366 1297 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:44.568141 1232 raft_consensus.cc:2955] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:44.594782 30488 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:57:44.594617 30220 catalog_manager.cc:5697] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 4 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:44.597512 1282 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:44.600255 30360 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:44.605422 30582 raft_consensus.cc:2955] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:44.623839 1261 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:44.636369 30364 raft_consensus.cc:1275] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 07:57:44.639547 1179 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:44.643136 30364 consensus_queue.cc:237] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:44.660897 30581 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 07:57:44.663658 1320 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260807 07:57:44.664729 30323 consensus_peers.cc:597] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d590969fc25f460ba23a897afd565f56. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:57:44.666647 30220 catalog_manager.cc:5697] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:44.618155 30488 raft_consensus.cc:2955] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:44.673471 30477 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:57:44.679951 30477 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 07:57:44.683629 1320 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:57:44.689426 31382 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:57:44.691181 1293 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:57:44.697258 1296 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:44.700664 30223 catalog_manager.cc:5697] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 5 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:44.716797 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:44.738458 30586 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:44.758380 1121 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:44.775220 30582 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:57:44.798369 31382 raft_consensus.cc:1275] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 07:57:44.821182 30222 catalog_manager.cc:5697] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:44.833948 1052 raft_consensus.cc:2955] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:44.806974 1297 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260807 07:57:44.866159 30582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:44.866935 30582 raft_consensus.cc:606] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 6 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:44.846346 1278 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260807 07:57:44.873816 30478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:44.874437 30478 raft_consensus.cc:606] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
W20260807 07:57:44.883172 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 79467.4us
I20260807 07:57:44.918067 30582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:44.918774 30582 raft_consensus.cc:606] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:44.979363 30366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:44.980068 30366 raft_consensus.cc:606] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
W20260807 07:57:45.009470 1356 log.cc:927] Time spent T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.126s user 0.001s sys 0.000s
W20260807 07:57:45.059754 1316 log.cc:927] Time spent T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
W20260807 07:57:45.081053 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 54560.2us
I20260807 07:57:45.082994 30369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8f2551f38a348389729e12d49142027"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:45.104753 30369 raft_consensus.cc:606] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
W20260807 07:57:45.093741 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 123401us
W20260807 07:57:45.142840 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 229227us
W20260807 07:57:45.164953 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 46031us
W20260807 07:57:45.169770 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 75506.8us
I20260807 07:57:45.176944 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 07:57:45.177858 1391 ts_tablet_manager.cc:933] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:45.185086 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:45.185972 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:45.191571 30582 raft_consensus.cc:2955] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
W20260807 07:57:45.229529 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 111151us
I20260807 07:57:45.234762 1390 ts_tablet_manager.cc:933] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:45.242530 30478 raft_consensus.cc:2955] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:45.249537 1386 raft_consensus.cc:993] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:45.250059 1386 raft_consensus.cc:1081] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 6 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:45.284773 1374 raft_consensus.cc:993] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:45.285457 1374 raft_consensus.cc:1081] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:45.287973 1374 raft_consensus.cc:993] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:45.288373 1374 raft_consensus.cc:1081] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:45.290553 1391 tablet_copy_client.cc:323] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:57:45.301433 30488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:57:45.309700 30488 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:45.310084 30488 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:45.320034 1400 ts_tablet_manager.cc:933] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:45.323916 30488 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:45.332163 30488 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:45.332291 1390 tablet_copy_client.cc:323] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:57:45.343150 30385 tablet_copy_service.cc:140] P b1188d7d3a0b455894bc443d571f6a19: Received BeginTabletCopySession request for tablet f2c57e3fb98348029b5e341d17d669bd from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:33338)
I20260807 07:57:45.346784 30385 tablet_copy_service.cc:161] P b1188d7d3a0b455894bc443d571f6a19: Beginning new tablet copy session on tablet f2c57e3fb98348029b5e341d17d669bd from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:33338: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-f2c57e3fb98348029b5e341d17d669bd
I20260807 07:57:45.365957 30386 tablet_copy_service.cc:140] P b1188d7d3a0b455894bc443d571f6a19: Received BeginTabletCopySession request for tablet af8f2d95eba240e2965db9be8b951bee from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:33338)
I20260807 07:57:45.366645 30386 tablet_copy_service.cc:161] P b1188d7d3a0b455894bc443d571f6a19: Beginning new tablet copy session on tablet af8f2d95eba240e2965db9be8b951bee from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:33338: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-af8f2d95eba240e2965db9be8b951bee
I20260807 07:57:45.374492 30582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:57:45.375068 30582 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:45.375425 30582 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:45.383797 30582 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:45.384821 30585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8f2551f38a348389729e12d49142027"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:57:45.386821 30585 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
W20260807 07:57:45.370858 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 166548us
I20260807 07:57:45.392133 30585 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:45.388665 30582 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:45.391062 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:45.393456 30477 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:45.406708 30385 tablet_copy_source_session.cc:215] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:45.407989 30477 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:57:45.410086 30488 raft_consensus.cc:1240] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 6. Current term is 7. Ops: []
I20260807 07:57:45.429286 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:45.430071 30360 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:45.430967 30585 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:45.438547 30539 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:45.440130 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:45.455965 30360 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:57:45.456835 1400 tablet_copy_client.cc:323] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:57:45.457584 1390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c57e3fb98348029b5e341d17d669bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:45.459132 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:45.474119 30588 raft_consensus.cc:3055] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:57:45.474453 30588 raft_consensus.cc:740] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:45.475167 30588 consensus_queue.cc:260] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:45.476406 30588 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:45.424815 1376 consensus_queue.cc:1059] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260807 07:57:45.467005 30386 tablet_copy_source_session.cc:215] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:45.469802 1298 raft_consensus.cc:993] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:45.479650 1226 raft_consensus.cc:993] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:45.475478 1304 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:57:45.497174 30588 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:57:45.487625 30385 tablet_copy_service.cc:140] P b1188d7d3a0b455894bc443d571f6a19: Received BeginTabletCopySession request for tablet d590969fc25f460ba23a897afd565f56 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:33338)
I20260807 07:57:45.498589 30385 tablet_copy_service.cc:161] P b1188d7d3a0b455894bc443d571f6a19: Beginning new tablet copy session on tablet d590969fc25f460ba23a897afd565f56 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:33338: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-d590969fc25f460ba23a897afd565f56
I20260807 07:57:45.515949 30385 tablet_copy_source_session.cc:215] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:45.525599 30429 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:45.534324 1121 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:57:45.534873 1121 raft_consensus.cc:697] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:45.524466 1226 raft_consensus.cc:1081] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:45.535717 1121 consensus_queue.cc:237] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:45.525928 1298 raft_consensus.cc:1081] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:45.537688 1304 raft_consensus.cc:697] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 7 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:45.538890 1391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af8f2d95eba240e2965db9be8b951bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:45.567692 1304 consensus_queue.cc:237] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:45.588878 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 101667us
I20260807 07:57:45.595242 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:45.595875 30364 raft_consensus.cc:3055] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:45.596163 30364 raft_consensus.cc:740] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
W20260807 07:57:45.541697 1316 log.cc:927] Time spent T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.440s user 0.000s sys 0.008s
I20260807 07:57:45.606295 30364 consensus_queue.cc:260] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:45.623997 30364 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:45.627761 1400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d590969fc25f460ba23a897afd565f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:45.662719 30364 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:45.649485 1316 tablet_bootstrap.cc:492] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260807 07:57:45.669781 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 61890.5us
I20260807 07:57:45.681195 30360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:45.681901 30360 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:45.682271 30360 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:45.704535 30585 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:45.733965 1316 tablet_bootstrap.cc:492] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:45.759009 1390 tablet_copy_client.cc:806] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:45.759759 1390 tablet_copy_client.cc:670] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
W20260807 07:57:45.798043 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 95162.1us
I20260807 07:57:45.800113 30541 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:57:45.801721 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:45.816890 30364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45054
I20260807 07:57:45.818336 30364 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:45.812579 30222 catalog_manager.cc:5697] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 2 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:45.819039 30364 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:45.816923 30366 raft_consensus.cc:3055] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:57:45.822093 30366 raft_consensus.cc:740] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:45.823680 30366 consensus_queue.cc:260] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:45.830806 30366 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:45.842957 1179 raft_consensus.cc:2804] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:45.843808 1179 raft_consensus.cc:697] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:45.869041 1316 ts_tablet_manager.cc:1403] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 1.344s user 0.040s sys 0.044s
I20260807 07:57:45.886402 1179 consensus_queue.cc:237] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:45.927623 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:45.928956 30476 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:45.928972 1390 tablet_copy_client.cc:538] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:45.955042 1400 tablet_copy_client.cc:806] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:45.956066 1400 tablet_copy_client.cc:670] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:45.968971 30476 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:45.970489 30366 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
W20260807 07:57:45.973598 1297 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260807 07:57:45.973925 30579 raft_consensus.cc:1240] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 7 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 6. Current term is 7. Ops: []
I20260807 07:57:45.945222 1316 raft_consensus.cc:359] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:45.979996 1400 tablet_copy_client.cc:538] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:45.972447 30364 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:45.985534 1316 raft_consensus.cc:740] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
W20260807 07:57:45.992815 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:57:46.003397 1316 consensus_queue.cc:260] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:46.007536 1316 ts_tablet_manager.cc:1434] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.137s user 0.009s sys 0.000s
I20260807 07:57:46.037592 30360 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:46.060012 30367 raft_consensus.cc:1240] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:46.067231 30605 tablet_copy_service.cc:342] P f831a53ec51d452398015797d543164e: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-457aab41fd17414ab083fedaf23f3ff8 received from {username='slave'} at 127.0.0.1:42218
I20260807 07:57:46.067955 30605 tablet_copy_service.cc:434] P f831a53ec51d452398015797d543164e: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-457aab41fd17414ab083fedaf23f3ff8 on tablet 457aab41fd17414ab083fedaf23f3ff8 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:46.068665 1391 tablet_copy_client.cc:806] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:46.069130 30360 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:46.069938 1391 tablet_copy_client.cc:670] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:46.074388 1391 tablet_copy_client.cc:538] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:46.028136 30364 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:46.104442 1390 tablet_bootstrap.cc:492] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:46.126305 31384 raft_consensus.cc:1217] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4] Dedup: 4.4->[]
I20260807 07:57:46.131632 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:46.132345 30579 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:46.133227 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:46.133931 30585 raft_consensus.cc:3055] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:46.134222 30585 raft_consensus.cc:740] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:46.135076 30585 consensus_queue.cc:260] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:46.136260 30585 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:46.132091 1415 consensus_queue.cc:1059] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:46.145018 1415 raft_consensus.cc:3055] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:46.145411 1415 raft_consensus.cc:740] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:46.146471 1415 consensus_queue.cc:260] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:46.148021 1415 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:46.150084 30360 raft_consensus.cc:1240] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6. Ops: []
I20260807 07:57:46.162981 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:46.163605 30482 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:46.166337 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:46.184508 30360 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:46.191756 30482 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:46.193570 30585 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:46.194279 30579 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:46.220629 30482 raft_consensus.cc:1275] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:46.223676 1179 consensus_queue.cc:1048] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:57:46.252684 30223 catalog_manager.cc:5697] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 6 to 7, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:46.255963 1391 tablet_bootstrap.cc:492] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:46.254426 30317 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:46.266155 1411 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260807 07:57:46.275126 1232 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:46.275765 1232 raft_consensus.cc:697] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:46.280975 30586 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:46.282450 30582 raft_consensus.cc:1240] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:46.276734 1232 consensus_queue.cc:237] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:46.284051 30360 raft_consensus.cc:1275] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:46.297761 30320 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:46.304018 1282 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:46.304821 1282 raft_consensus.cc:697] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:46.307224 1282 consensus_queue.cc:237] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:46.263999 1400 tablet_bootstrap.cc:492] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:46.322454 1430 consensus_queue.cc:1048] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:57:46.328584 1411 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:46.334311 30223 catalog_manager.cc:5697] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e reported cstate change: term changed from 6 to 7, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 7 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:46.364987 30480 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:46.391448 30223 catalog_manager.cc:5697] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 4 to 5, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 5 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
W20260807 07:57:46.617559 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 86062.3us
I20260807 07:57:46.662618 30360 raft_consensus.cc:1275] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260807 07:57:46.693415 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 67719.8us
I20260807 07:57:46.691536 1463 consensus_queue.cc:1048] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260807 07:57:46.789917 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 49716.7us
W20260807 07:57:46.794068 1390 log.cc:927] Time spent T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.080s user 0.000s sys 0.000s
I20260807 07:57:46.812736 1391 tablet_bootstrap.cc:492] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:46.834509 1391 tablet_bootstrap.cc:492] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
W20260807 07:57:46.770573 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 58997.9us
W20260807 07:57:46.895977 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 161843us
I20260807 07:57:46.904151 30587 raft_consensus.cc:1275] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260807 07:57:46.903331 1390 log.cc:927] Time spent T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.074s user 0.004s sys 0.000s
I20260807 07:57:46.919842 1390 tablet_bootstrap.cc:492] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:46.920830 1390 tablet_bootstrap.cc:492] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:46.989662 1480 consensus_queue.cc:1048] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:46.965938 1390 ts_tablet_manager.cc:1403] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.862s user 0.024s sys 0.017s
I20260807 07:57:47.134898 1390 raft_consensus.cc:359] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:47.135782 1390 raft_consensus.cc:740] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:47.136423 1390 consensus_queue.cc:260] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:57:47.148154 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 106508us
I20260807 07:57:47.175519 1391 ts_tablet_manager.cc:1403] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.920s user 0.019s sys 0.032s
I20260807 07:57:47.181769 1390 ts_tablet_manager.cc:1434] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.180s user 0.007s sys 0.001s
I20260807 07:57:47.188484 1400 tablet_bootstrap.cc:492] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:47.189761 1400 tablet_bootstrap.cc:492] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:47.202404 1467 raft_consensus.cc:1064] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:47.203794 1400 ts_tablet_manager.cc:1403] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.965s user 0.022s sys 0.017s
I20260807 07:57:47.210268 30482 raft_consensus.cc:1275] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:57:47.214985 1467 consensus_queue.cc:237] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:47.227761 1304 consensus_queue.cc:1048] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260807 07:57:47.231994 1400 raft_consensus.cc:359] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:47.245795 1400 raft_consensus.cc:740] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:47.246515 1400 consensus_queue.cc:260] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:47.250409 1400 ts_tablet_manager.cc:1434] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.046s user 0.005s sys 0.003s
I20260807 07:57:47.252420 1391 raft_consensus.cc:359] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:47.253306 1391 raft_consensus.cc:740] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:47.254024 1391 consensus_queue.cc:260] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:47.256458 1391 ts_tablet_manager.cc:1434] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.080s user 0.003s sys 0.003s
I20260807 07:57:47.256817 30221 catalog_manager.cc:5697] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 5 to 6, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:47.276391 30476 raft_consensus.cc:1275] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260807 07:57:47.286324 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 44999.7us
I20260807 07:57:47.289098 30588 raft_consensus.cc:1275] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:47.290584 30220 catalog_manager.cc:5697] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 4 to 5, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:57:47.292179 30385 tablet_copy_service.cc:342] P b1188d7d3a0b455894bc443d571f6a19: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-f2c57e3fb98348029b5e341d17d669bd received from {username='slave'} at 127.0.0.1:33338
I20260807 07:57:47.292665 30385 tablet_copy_service.cc:434] P b1188d7d3a0b455894bc443d571f6a19: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-f2c57e3fb98348029b5e341d17d669bd on tablet f2c57e3fb98348029b5e341d17d669bd with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:47.294271 30386 tablet_copy_service.cc:342] P b1188d7d3a0b455894bc443d571f6a19: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-d590969fc25f460ba23a897afd565f56 received from {username='slave'} at 127.0.0.1:33338
I20260807 07:57:47.294696 30386 tablet_copy_service.cc:434] P b1188d7d3a0b455894bc443d571f6a19: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-d590969fc25f460ba23a897afd565f56 on tablet d590969fc25f460ba23a897afd565f56 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:47.325106 1372 consensus_queue.cc:1048] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:47.330840 1476 consensus_queue.cc:1048] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:47.331744 30383 tablet_copy_service.cc:342] P b1188d7d3a0b455894bc443d571f6a19: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-af8f2d95eba240e2965db9be8b951bee received from {username='slave'} at 127.0.0.1:33338
I20260807 07:57:47.332268 30383 tablet_copy_service.cc:434] P b1188d7d3a0b455894bc443d571f6a19: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-af8f2d95eba240e2965db9be8b951bee on tablet af8f2d95eba240e2965db9be8b951bee with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:47.341857 30482 raft_consensus.cc:1275] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:57:47.353856 31382 raft_consensus.cc:1217] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4] Dedup: 5.4->[]
I20260807 07:57:47.351616 1282 consensus_queue.cc:1048] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260807 07:57:47.373013 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:47.403362 30477 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:57:47.405907 31382 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEARNER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:57:47.407976 1505 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260807 07:57:47.410279 1428 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:57:47.428324 30360 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:57:47.448300 1428 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260807 07:57:47.518637 1428 raft_consensus.cc:2955] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:57:47.522825 1521 log.cc:927] Time spent T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260807 07:57:47.522917 31382 raft_consensus.cc:2955] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:47.540329 30477 raft_consensus.cc:2955] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:47.584506 31385 raft_consensus.cc:1217] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5] Dedup: 5.5->[]
I20260807 07:57:47.626529 30369 raft_consensus.cc:2955] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:47.635705 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37222025709f4384a02a9c633ee3190c"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:47.636669 30476 raft_consensus.cc:606] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:47.641481 30587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:47.642114 30587 raft_consensus.cc:606] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:47.645207 30222 catalog_manager.cc:5697] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:57:47.646435 30360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d590969fc25f460ba23a897afd565f56"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:47.646998 30360 raft_consensus.cc:606] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:57:47.651038 30587 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:47.651567 30587 raft_consensus.cc:606] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:47.652688 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 07:57:47.655277 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:47.660985 1430 raft_consensus.cc:993] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:47.661589 1430 raft_consensus.cc:1081] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:47.664593 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:47.665622 30360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45054
I20260807 07:57:47.666201 30360 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:47.666520 30360 raft_consensus.cc:3060] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:47.683498 1514 raft_consensus.cc:993] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:47.684147 1415 raft_consensus.cc:1081] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:47.684374 30360 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:47.686021 30358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37222025709f4384a02a9c633ee3190c"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:47.686584 30358 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:47.686923 30358 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:47.698225 30358 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:47.709529 30587 consensus_queue.cc:237] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:47.722543 30360 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:47.740842 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:47.741572 30476 raft_consensus.cc:3055] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:57:47.741987 30476 raft_consensus.cc:740] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:47.742908 30476 consensus_queue.cc:260] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:47.744025 30476 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:47.746800 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:47.728899 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:47.723546 31382 raft_consensus.cc:1217] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260807 07:57:47.747383 30578 raft_consensus.cc:3055] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:47.747728 30578 raft_consensus.cc:740] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:47.748203 31385 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 07:57:47.748433 30578 consensus_queue.cc:260] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:47.749933 30578 raft_consensus.cc:3060] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:47.755106 1430 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:47.755959 30490 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 07:57:47.757413 1467 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:47.765669 1431 raft_consensus.cc:2955] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:47.772787 30490 raft_consensus.cc:2955] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:47.775363 31385 raft_consensus.cc:2955] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:47.781876 30578 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
W20260807 07:57:47.785147 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 46879.1us
I20260807 07:57:47.752694 30477 raft_consensus.cc:3060] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:47.792192 30358 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:47.799830 30320 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:47.804141 1484 raft_consensus.cc:2804] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:47.804617 1484 raft_consensus.cc:697] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:47.807075 30477 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:57:47.807180 1484 consensus_queue.cc:237] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:47.815099 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:47.815660 30578 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:47.824419 30476 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:57:47.823137 30221 catalog_manager.cc:5697] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index 5 to 6, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New cstate: current_term: 4 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:47.828859 30317 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:47.837901 30578 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:57:47.843828 1365 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:57:47.854866 1365 raft_consensus.cc:697] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:47.858677 1365 consensus_queue.cc:237] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:47.869675 1483 raft_consensus.cc:1064] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:47.936735 1297 raft_consensus.cc:993] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:47.980139 30345 tablet_service.cc:1558] Processing DeleteTablet for tablet 457aab41fd17414ab083fedaf23f3ff8 with delete_type TABLET_DATA_TOMBSTONED (TS b1188d7d3a0b455894bc443d571f6a19 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45034
I20260807 07:57:47.981154 1483 consensus_queue.cc:237] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:47.977994 1297 raft_consensus.cc:1081] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:48.042737 30221 catalog_manager.cc:5697] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 2 to 3, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:48.094516 1532 raft_consensus.cc:993] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:48.095185 1532 raft_consensus.cc:1081] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:48.115142 30477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:57:48.115727 30477 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:48.116052 30477 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:57:48.133754 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 58635us
I20260807 07:57:48.136579 1536 tablet_replica.cc:333] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19: stopping tablet replica
I20260807 07:57:48.137655 1536 raft_consensus.cc:2243] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 07:57:48.139014 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 457aab41fd17414ab083fedaf23f3ff8 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:57:48.143415 1536 raft_consensus.cc:2272] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:57:48.150465 30490 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:57:48.155100 1297 raft_consensus.cc:1064] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:48.167320 1297 consensus_queue.cc:237] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:48.168237 31382 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:57:48.174537 30477 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:48.185573 30578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d590969fc25f460ba23a897afd565f56"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:57:48.186185 30578 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:48.186542 30578 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:48.189545 1466 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:48.192438 1296 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:57:48.195096 30477 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:48.201704 1536 ts_tablet_manager.cc:1916] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:57:48.203939 30578 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:48.221145 30578 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:48.225862 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:48.226857 30477 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:48.238406 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:48.239022 30369 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:48.239477 30578 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:57:48.243698 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:48.244237 30364 raft_consensus.cc:3055] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:48.244514 30364 raft_consensus.cc:740] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:48.245340 30364 consensus_queue.cc:260] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:48.246711 30364 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:48.248826 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:48.249428 30588 raft_consensus.cc:3055] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:48.249703 30588 raft_consensus.cc:740] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:48.250375 30588 consensus_queue.cc:260] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:48.259680 30364 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:57:48.261345 1481 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:57:48.265942 30588 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:48.272758 30369 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:48.287549 30588 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:48.288763 30477 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
W20260807 07:57:48.300348 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 43802.4us
I20260807 07:57:48.306705 30477 raft_consensus.cc:1275] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:57:48.308341 30539 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:48.317308 1505 raft_consensus.cc:2804] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:48.318005 1505 raft_consensus.cc:697] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:48.319013 1505 consensus_queue.cc:237] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:57:48.345139 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 89762.9us
I20260807 07:57:48.344183 1483 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260807 07:57:48.345171 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 51868us
W20260807 07:57:48.504895 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 159569us
I20260807 07:57:48.538347 30587 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:48.539850 30578 raft_consensus.cc:1275] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:57:48.389735 30429 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:48.654949 30223 catalog_manager.cc:5697] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 6 to 7, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:48.652854 1484 raft_consensus.cc:2955] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:57:48.679352 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 118702us
I20260807 07:57:48.676367 31382 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:57:48.686250 1536 ts_tablet_manager.cc:1929] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260807 07:57:48.686707 1291 raft_consensus.cc:2804] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:48.687309 1291 raft_consensus.cc:697] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:48.688236 1291 consensus_queue.cc:237] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:57:48.686357 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 296685us
I20260807 07:57:48.686866 1536 log.cc:1199] T 457aab41fd17414ab083fedaf23f3ff8 P b1188d7d3a0b455894bc443d571f6a19: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root/wals/457aab41fd17414ab083fedaf23f3ff8
I20260807 07:57:48.728070 1282 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:48.744634 30587 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:57:48.728626 1481 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:48.753638 30203 catalog_manager.cc:5028] TS b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): tablet 457aab41fd17414ab083fedaf23f3ff8 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:57:48.766731 30588 raft_consensus.cc:2955] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:48.791138 30221 catalog_manager.cc:5697] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 2 to 3, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:48.801647 30477 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:57:48.802281 30482 raft_consensus.cc:2955] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:48.807657 30477 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:48.813160 1476 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260807 07:57:48.831102 31382 raft_consensus.cc:2955] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:48.863057 1232 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:57:48.895018 30477 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260807 07:57:48.901291 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 56275.2us
W20260807 07:57:48.913805 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 68759us
I20260807 07:57:48.933240 1563 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:57:48.916177 1481 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
W20260807 07:57:48.969399 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 154774us
I20260807 07:57:48.970752 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
W20260807 07:57:48.977744 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 83632us
W20260807 07:57:48.988716 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 67009us
W20260807 07:57:49.035328 1531 log.cc:927] Time spent T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.061s user 0.000s sys 0.001s
I20260807 07:57:49.063833 31382 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 LEARNER]: Advancing to term 3
I20260807 07:57:49.100996 31382 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260807 07:57:49.105904 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 184044us
I20260807 07:57:49.117226 1428 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:49.134050 30365 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:49.146031 1415 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:49.184556 30222 catalog_manager.cc:5697] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 3 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:49.186563 30222 catalog_manager.cc:5697] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:49.278609 1534 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260807 07:57:49.318696 1282 raft_consensus.cc:2955] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:49.323290 30477 raft_consensus.cc:2955] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:49.350149 31382 raft_consensus.cc:2955] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:49.379603 30369 consensus_queue.cc:237] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:49.392205 1489 raft_consensus.cc:1064] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
W20260807 07:57:49.392787 1489 raft_consensus.cc:1068] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e: Unable to promote non-voter 6bd20e9c0d3e4ace86fc1f55ab9425fa: Illegal state: Leader has not yet committed an operation in its own term
I20260807 07:57:49.394821 31384 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:57:49.415668 1563 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260807 07:57:49.434543 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 44780.5us
I20260807 07:57:49.441354 30487 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:57:49.445051 30365 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 07:57:49.458727 1484 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260807 07:57:49.463904 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 213627us
I20260807 07:57:49.484021 1564 raft_consensus.cc:2955] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:49.488718 31385 raft_consensus.cc:2955] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:49.490252 30487 raft_consensus.cc:2955] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:49.519775 1428 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:49.532146 30587 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:49.538491 30590 raft_consensus.cc:2955] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:49.560621 1571 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:49.611608 30220 catalog_manager.cc:5697] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:57:49.640506 30367 consensus_queue.cc:237] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:49.643399 1534 raft_consensus.cc:1064] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:49.648386 30358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:49.649011 30358 raft_consensus.cc:606] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:57:49.660914 31383 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:57:49.666344 1483 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:57:49.671445 30478 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:57:49.664666 30220 catalog_manager.cc:5697] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 5 to 6, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:49.671765 30365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:49.672358 30365 raft_consensus.cc:606] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:57:49.679405 30585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:49.679929 30585 raft_consensus.cc:606] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:49.684522 30487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:49.685036 30487 raft_consensus.cc:606] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:49.688933 1484 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:57:49.697918 30366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:49.698501 30366 raft_consensus.cc:606] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:57:49.700460 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 07:57:49.709184 1481 raft_consensus.cc:2955] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:49.722048 31383 raft_consensus.cc:2955] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:49.735509 30478 raft_consensus.cc:2955] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:49.725010 1534 consensus_queue.cc:237] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:49.780901 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:49.786976 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
W20260807 07:57:49.803110 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 59564.6us
I20260807 07:57:49.806660 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet af8f2d95eba240e2965db9be8b951bee with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:57:49.833221 30564 tablet_service.cc:1558] Processing DeleteTablet for tablet af8f2d95eba240e2965db9be8b951bee with delete_type TABLET_DATA_TOMBSTONED (TS f831a53ec51d452398015797d543164e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34588
I20260807 07:57:49.866149 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2c57e3fb98348029b5e341d17d669bd with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:57:49.888722 30365 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:49.895339 1570 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:49.907501 1484 raft_consensus.cc:993] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:49.908030 1484 raft_consensus.cc:1081] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:49.911079 31383 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:49.917874 30221 catalog_manager.cc:5697] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 6 to 7, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:57:49.935621 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 126951us
I20260807 07:57:49.936303 1612 tablet_replica.cc:333] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e: stopping tablet replica
I20260807 07:57:49.937716 1612 raft_consensus.cc:2243] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 07:57:49.938625 1612 raft_consensus.cc:2272] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 07:57:49.945001 1612 ts_tablet_manager.cc:1916] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:57:49.945713 1428 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:57:49.950212 30578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:57:49.950760 30578 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:49.951078 30578 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:49.971449 1431 raft_consensus.cc:2955] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:49.988660 31383 raft_consensus.cc:2955] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:50.003158 1296 raft_consensus.cc:993] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:50.003698 1296 raft_consensus.cc:1081] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:49.995481 30578 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:50.012533 30581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:57:50.013151 30581 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:50.013597 30581 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:50.013935 30564 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c57e3fb98348029b5e341d17d669bd with delete_type TABLET_DATA_TOMBSTONED (TS f831a53ec51d452398015797d543164e not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34588
I20260807 07:57:50.015923 30578 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:50.029990 30581 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:50.030578 30478 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:50.030483 1539 raft_consensus.cc:993] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:50.051397 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:50.052008 30487 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:50.063215 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:50.063865 30365 raft_consensus.cc:3055] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:57:50.064172 30365 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:50.064975 30365 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:50.065670 1539 raft_consensus.cc:1081] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:50.066200 30365 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:50.059878 30487 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:57:50.086748 1547 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:50.087363 1587 raft_consensus.cc:993] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:50.088300 1587 raft_consensus.cc:1081] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:50.099246 30364 raft_consensus.cc:2955] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:50.110769 30220 catalog_manager.cc:5697] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 3 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:50.130290 30582 consensus_queue.cc:237] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:50.131119 1612 ts_tablet_manager.cc:1929] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260807 07:57:50.131589 1612 log.cc:1199] T af8f2d95eba240e2965db9be8b951bee P f831a53ec51d452398015797d543164e: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root/wals/af8f2d95eba240e2965db9be8b951bee
I20260807 07:57:50.133502 30203 catalog_manager.cc:5028] TS f831a53ec51d452398015797d543164e (127.27.64.131:33207): tablet af8f2d95eba240e2965db9be8b951bee (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:57:50.135738 30581 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:50.136564 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:50.137157 30369 raft_consensus.cc:3055] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:50.137470 30369 raft_consensus.cc:740] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:50.138164 30369 consensus_queue.cc:260] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:50.139106 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:50.139390 30369 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:50.139681 31383 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:50.144368 30539 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:50.145359 1596 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:57:50.145857 1596 raft_consensus.cc:697] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 8 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:50.146656 1596 consensus_queue.cc:237] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:50.149049 30365 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:57:50.149832 30478 raft_consensus.cc:2955] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:50.140375 31385 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 07:57:50.152801 30482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:57:50.178356 30482 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:50.178764 30482 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:50.181458 30366 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 07:57:50.187561 1428 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:50.189448 1428 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:50.190659 1481 raft_consensus.cc:993] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:50.191159 1481 raft_consensus.cc:1081] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:50.193655 30581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:57:50.194154 30581 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:50.194463 30581 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:50.196719 30482 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:50.196709 1597 raft_consensus.cc:2955] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:50.200840 31385 raft_consensus.cc:2955] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:50.210419 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:50.211020 31382 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:50.214313 30366 raft_consensus.cc:2955] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:50.216425 30581 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:50.218709 31382 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:50.218930 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:50.168705 31383 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:50.219561 30358 raft_consensus.cc:3055] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:50.219874 30358 raft_consensus.cc:740] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
W20260807 07:57:50.172391 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 45444.6us
I20260807 07:57:50.163009 30369 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:50.220592 30358 consensus_queue.cc:260] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:50.221473 30482 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:50.221654 30358 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:50.221817 30542 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:50.222643 1570 raft_consensus.cc:2804] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:50.223122 1570 raft_consensus.cc:697] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:50.224020 1570 consensus_queue.cc:237] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:50.230151 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d590969fc25f460ba23a897afd565f56 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:57:50.231209 30581 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:50.231699 30430 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:50.230197 30358 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:50.233690 30541 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:50.234604 1431 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:50.235138 1431 raft_consensus.cc:697] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:50.238428 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:50.239044 30478 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:50.239846 1369 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:50.236851 1431 consensus_queue.cc:237] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:50.242800 1369 raft_consensus.cc:697] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:50.243707 1369 consensus_queue.cc:237] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:50.263912 30358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:50.264550 30358 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:50.264887 30358 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:57:50.281104 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:50.281733 30582 raft_consensus.cc:3055] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:50.281975 30582 raft_consensus.cc:740] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:50.287405 30478 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:50.293427 30358 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:50.282552 30582 consensus_queue.cc:260] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:50.296383 30369 raft_consensus.cc:1240] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 8. Current term is 9. Ops: []
I20260807 07:57:50.296469 30582 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:50.304667 1612 tablet_replica.cc:333] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e: stopping tablet replica
I20260807 07:57:50.308027 30358 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:50.297987 30222 catalog_manager.cc:5697] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 5 to 6, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:50.311640 1612 raft_consensus.cc:2243] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 07:57:50.312050 1550 consensus_queue.cc:1059] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:57:50.319103 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:50.319725 30585 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:57:50.312551 1612 raft_consensus.cc:2272] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 07:57:50.328508 30585 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 9.
I20260807 07:57:50.339723 30320 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:50.344873 30582 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:57:50.323562 1479 raft_consensus.cc:3055] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:57:50.346742 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:50.350278 1612 ts_tablet_manager.cc:1916] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:57:50.350759 1476 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 07:57:50.351282 1476 raft_consensus.cc:697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 9 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:50.352213 1476 consensus_queue.cc:237] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:50.371424 30590 raft_consensus.cc:1240] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 8. Current term is 9. Ops: []
I20260807 07:57:50.379890 30459 tablet_service.cc:1558] Processing DeleteTablet for tablet d590969fc25f460ba23a897afd565f56 with delete_type TABLET_DATA_TOMBSTONED (TS ef1ca7acf52a438f89f14707e9e06818 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:33906
I20260807 07:57:50.381809 1479 raft_consensus.cc:740] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:50.382464 1609 consensus_queue.cc:1059] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:57:50.397346 1479 consensus_queue.cc:260] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:50.400463 1479 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:57:50.437695 30221 catalog_manager.cc:5697] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 7 to 8, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 8 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:50.434585 1623 tablet_replica.cc:333] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818: stopping tablet replica
I20260807 07:57:50.439836 30221 catalog_manager.cc:5697] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e reported cstate change: term changed from 4 to 5, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 5 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:50.448784 1623 raft_consensus.cc:2243] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 07:57:50.449689 1623 raft_consensus.cc:2272] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:57:50.450901 30222 catalog_manager.cc:5697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 8 to 9, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 9 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:50.454811 30221 catalog_manager.cc:5697] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 5 to 6, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:50.460474 1623 ts_tablet_manager.cc:1916] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:57:50.451957 30223 catalog_manager.cc:5697] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 4 to 5, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:50.506378 1623 ts_tablet_manager.cc:1929] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260807 07:57:50.506937 1623 log.cc:1199] T d590969fc25f460ba23a897afd565f56 P ef1ca7acf52a438f89f14707e9e06818: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root/wals/d590969fc25f460ba23a897afd565f56
I20260807 07:57:50.509407 30201 catalog_manager.cc:5028] TS ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): tablet d590969fc25f460ba23a897afd565f56 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:57:50.552757 30489 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 9.
I20260807 07:57:50.557673 1612 ts_tablet_manager.cc:1929] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260807 07:57:50.560475 1612 log.cc:1199] T f2c57e3fb98348029b5e341d17d669bd P f831a53ec51d452398015797d543164e: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root/wals/f2c57e3fb98348029b5e341d17d669bd
I20260807 07:57:50.569841 30203 catalog_manager.cc:5028] TS f831a53ec51d452398015797d543164e (127.27.64.131:33207): tablet f2c57e3fb98348029b5e341d17d669bd (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:57:50.620733 31385 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:57:50.624661 1597 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:50.635337 30369 raft_consensus.cc:1275] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:50.640661 1428 consensus_queue.cc:1048] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:50.663244 31383 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:57:50.668975 1548 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:57:50.724588 30482 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 07:57:50.731206 1596 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:57:50.738655 30369 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:57:50.740059 30358 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 07:57:50.742110 30585 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:57:50.751405 1539 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:57:50.770558 1489 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260807 07:57:50.770231 1428 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260807 07:57:50.794389 30478 raft_consensus.cc:1275] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:50.811877 1489 consensus_queue.cc:1048] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260807 07:57:50.965361 30489 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 07:57:50.969040 1481 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:50.989915 30590 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260807 07:57:51.031443 1297 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:57:51.126344 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:51.224732 30582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:51.225369 30582 raft_consensus.cc:606] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:51.228401 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:51.228971 30477 raft_consensus.cc:606] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:51.230823 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 07:57:51.232828 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:51.233587 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:51.333639 1615 raft_consensus.cc:993] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:51.334239 1615 raft_consensus.cc:1081] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:51.336180 30358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:51.336716 30358 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:51.337046 30358 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:51.344882 30358 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:51.347641 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:51.348214 30487 raft_consensus.cc:3055] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:51.348511 30487 raft_consensus.cc:740] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:51.349222 30487 consensus_queue.cc:260] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:51.350380 30487 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:51.350608 30358 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:51.350826 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:51.351408 30590 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:51.359957 30590 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:51.373438 30320 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:51.374289 1297 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:51.374795 1297 raft_consensus.cc:697] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:51.375661 1297 consensus_queue.cc:237] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:51.431066 30487 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:51.451773 30223 catalog_manager.cc:5697] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 4 to 5, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:51.574681 30487 consensus_queue.cc:237] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:57:51.589537 30430 consensus_peers.cc:597] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5df190e0d6d146e8a2f82d090c06ecdf. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:57:51.590394 30590 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:57:51.591777 30369 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:57:51.592823 1615 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:51.593796 1616 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:51.623257 1616 raft_consensus.cc:2955] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:51.624831 30590 raft_consensus.cc:2955] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:51.650640 30223 catalog_manager.cc:5697] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:51.667941 30369 consensus_queue.cc:237] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:51.672343 30367 raft_consensus.cc:2955] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
W20260807 07:57:51.704495 30323 consensus_peers.cc:597] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37222025709f4384a02a9c633ee3190c. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:57:51.704596 30582 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:57:51.707935 30487 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:57:51.709575 1476 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:51.710554 1563 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:51.718677 1489 raft_consensus.cc:993] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:51.719858 1648 raft_consensus.cc:1081] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:51.722146 30477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:57:51.722726 30477 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:51.723097 30477 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:51.756240 30477 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:51.760818 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:51.761442 30367 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:51.768376 30367 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:51.769713 30429 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:51.770639 1539 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:51.771155 1539 raft_consensus.cc:697] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:51.772567 30477 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:51.773955 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:51.774626 30590 raft_consensus.cc:3055] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:51.774904 30590 raft_consensus.cc:740] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:51.771947 1539 consensus_queue.cc:237] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:51.782120 30590 consensus_queue.cc:260] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:51.783248 30590 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:51.795264 30590 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:51.821568 1563 raft_consensus.cc:2955] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:51.827768 30590 raft_consensus.cc:2955] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:51.839076 30582 consensus_queue.cc:237] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:51.844242 30223 catalog_manager.cc:5697] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:51.857138 30221 catalog_manager.cc:5697] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 5 to 6, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:51.871034 30487 raft_consensus.cc:2955] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
W20260807 07:57:51.882459 30542 consensus_peers.cc:597] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9136a853c15441a6a0460d9da5efd3e9. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:57:51.887018 30367 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:51.888705 1648 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:51.891088 30477 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:51.892686 1489 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:51.924466 30590 raft_consensus.cc:1275] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:51.926156 1563 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:51.936784 30487 raft_consensus.cc:1275] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:51.940064 1563 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:52.079511 1691 ts_tablet_manager.cc:933] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:52.095258 1597 raft_consensus.cc:2955] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:52.096964 30369 raft_consensus.cc:2955] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:52.100797 1691 tablet_copy_client.cc:323] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
I20260807 07:57:52.122509 30502 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet 5df190e0d6d146e8a2f82d090c06ecdf from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
I20260807 07:57:52.123080 30502 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet 5df190e0d6d146e8a2f82d090c06ecdf from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-5df190e0d6d146e8a2f82d090c06ecdf
I20260807 07:57:52.136615 30223 catalog_manager.cc:5697] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:52.137435 30487 raft_consensus.cc:2955] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:52.142320 30502 tablet_copy_source_session.cc:215] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
W20260807 07:57:52.145344 30294 auto_rebalancer.cc:644] Failed to schedule move for tablet 5b78e546552f4ce38217f522549d6f36: Illegal state: Leader has not yet committed an operation in its own term
I20260807 07:57:52.164346 1691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df190e0d6d146e8a2f82d090c06ecdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:52.193286 1691 tablet_copy_client.cc:806] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:52.194888 1691 tablet_copy_client.cc:670] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:52.197582 30590 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:52.199200 1539 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:52.200881 1691 tablet_copy_client.cc:538] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:52.220043 1691 tablet_bootstrap.cc:492] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:52.224900 30369 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:52.228032 1616 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:52.306145 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:52.321306 1698 ts_tablet_manager.cc:933] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
W20260807 07:57:52.377104 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 57800.8us
W20260807 07:57:52.387570 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 76191.7us
I20260807 07:57:52.394198 1698 tablet_copy_client.cc:323] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:57:52.398185 30383 tablet_copy_service.cc:140] P b1188d7d3a0b455894bc443d571f6a19: Received BeginTabletCopySession request for tablet 37222025709f4384a02a9c633ee3190c from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:33338)
I20260807 07:57:52.398734 30383 tablet_copy_service.cc:161] P b1188d7d3a0b455894bc443d571f6a19: Beginning new tablet copy session on tablet 37222025709f4384a02a9c633ee3190c from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:33338: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-37222025709f4384a02a9c633ee3190c
I20260807 07:57:52.412381 1708 ts_tablet_manager.cc:933] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:52.421851 30383 tablet_copy_source_session.cc:215] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:52.430119 1698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37222025709f4384a02a9c633ee3190c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:52.449501 1708 tablet_copy_client.cc:323] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.131:33207
I20260807 07:57:52.457398 30369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:52.461726 30369 raft_consensus.cc:606] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:57:52.464002 30605 tablet_copy_service.cc:140] P f831a53ec51d452398015797d543164e: Received BeginTabletCopySession request for tablet 9136a853c15441a6a0460d9da5efd3e9 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:42218)
I20260807 07:57:52.464546 30605 tablet_copy_service.cc:161] P f831a53ec51d452398015797d543164e: Beginning new tablet copy session on tablet 9136a853c15441a6a0460d9da5efd3e9 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:42218: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-9136a853c15441a6a0460d9da5efd3e9
I20260807 07:57:52.471549 1691 tablet_bootstrap.cc:492] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:52.472554 1691 tablet_bootstrap.cc:492] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:52.473336 1691 ts_tablet_manager.cc:1403] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.254s user 0.033s sys 0.000s
I20260807 07:57:52.476418 1691 raft_consensus.cc:359] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:52.477581 30590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:52.478425 30590 raft_consensus.cc:606] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 3 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:52.477759 30605 tablet_copy_source_session.cc:215] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:52.477567 1691 raft_consensus.cc:740] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:52.480443 1691 consensus_queue.cc:260] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:52.481207 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:52.492566 30477 raft_consensus.cc:606] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:52.492915 1698 tablet_copy_client.cc:806] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:52.493530 1698 tablet_copy_client.cc:670] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:52.484565 1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9136a853c15441a6a0460d9da5efd3e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:52.501509 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:52.502151 30477 raft_consensus.cc:606] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:52.506850 30369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:52.507377 30369 raft_consensus.cc:606] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:52.510521 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 07:57:52.512306 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:52.513254 1698 tablet_copy_client.cc:538] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:52.516889 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:52.542464 1563 raft_consensus.cc:993] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:52.543192 1476 raft_consensus.cc:1081] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:52.545264 30487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:57:52.545861 30487 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:52.546170 30487 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:52.549463 1698 tablet_bootstrap.cc:492] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:52.614769 1615 raft_consensus.cc:993] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:52.615316 1615 raft_consensus.cc:1081] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:52.623577 30369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:52.624230 30369 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:52.624637 30369 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:52.639541 30487 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:52.644251 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:52.644810 31385 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:52.653508 31385 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:52.655975 30430 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:52.656958 1702 raft_consensus.cc:2804] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:52.658269 1702 raft_consensus.cc:697] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:52.659281 1702 consensus_queue.cc:237] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:52.682091 1691 ts_tablet_manager.cc:1434] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.208s user 0.005s sys 0.001s
I20260807 07:57:52.699476 31385 raft_consensus.cc:1217] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6] Dedup: 7.6->[]
I20260807 07:57:52.704325 1698 tablet_bootstrap.cc:492] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:52.709635 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:52.719898 30222 catalog_manager.cc:5697] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 5 to 6, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:52.738713 30358 raft_consensus.cc:3055] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:52.739229 30358 raft_consensus.cc:740] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:52.740072 30358 consensus_queue.cc:260] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:52.741295 30358 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:52.742055 1698 tablet_bootstrap.cc:492] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:52.745198 1698 ts_tablet_manager.cc:1403] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.196s user 0.033s sys 0.004s
I20260807 07:57:52.738642 30487 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:52.750425 1563 raft_consensus.cc:993] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:52.764843 1563 raft_consensus.cc:1081] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:52.750505 1698 raft_consensus.cc:359] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:52.758870 30502 tablet_copy_service.cc:342] P ef1ca7acf52a438f89f14707e9e06818: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-5df190e0d6d146e8a2f82d090c06ecdf received from {username='slave'} at 127.0.0.1:34358
I20260807 07:57:52.766124 1698 raft_consensus.cc:740] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:52.766271 30502 tablet_copy_service.cc:434] P ef1ca7acf52a438f89f14707e9e06818: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-5df190e0d6d146e8a2f82d090c06ecdf on tablet 5df190e0d6d146e8a2f82d090c06ecdf with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:52.766907 1698 consensus_queue.cc:260] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:52.769765 1698 ts_tablet_manager.cc:1434] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.024s user 0.004s sys 0.003s
I20260807 07:57:52.776242 30383 tablet_copy_service.cc:342] P b1188d7d3a0b455894bc443d571f6a19: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-37222025709f4384a02a9c633ee3190c received from {username='slave'} at 127.0.0.1:33338
I20260807 07:57:52.776604 30383 tablet_copy_service.cc:434] P b1188d7d3a0b455894bc443d571f6a19: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-37222025709f4384a02a9c633ee3190c on tablet 37222025709f4384a02a9c633ee3190c with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:52.780189 30369 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:52.798170 1700 raft_consensus.cc:993] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:52.798511 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:52.798767 1597 raft_consensus.cc:1081] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 3 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:52.799134 30477 raft_consensus.cc:3055] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:57:52.799441 30477 raft_consensus.cc:740] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:52.800137 30477 consensus_queue.cc:260] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:52.801216 30477 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:52.801780 30487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:57:52.802306 30487 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:52.802627 30487 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:52.809597 30487 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:52.809870 30477 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:57:52.820942 30317 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:52.822237 1476 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:57:52.822734 1476 raft_consensus.cc:697] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:52.823520 1476 consensus_queue.cc:237] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:52.828984 1539 raft_consensus.cc:993] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:52.829563 1539 raft_consensus.cc:1081] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:52.790887 1708 tablet_copy_client.cc:806] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:52.831382 30367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:52.812318 30358 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:52.832347 30367 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:52.813098 30369 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:52.829437 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:57:52.830649 30487 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:57:52.833207 31385 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:52.835590 30590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:57:52.836225 30590 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:52.836623 30590 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:52.832726 30367 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:52.844378 31385 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:57:52.845660 30430 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:52.846432 1539 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:52.846896 1539 raft_consensus.cc:697] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:52.847438 30590 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:52.847795 1539 consensus_queue.cc:237] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:52.830344 1708 tablet_copy_client.cc:670] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:52.850288 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:52.850821 30487 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:52.851483 30223 catalog_manager.cc:5697] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 7 to 8, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 8 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:52.853957 30367 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:52.856976 30367 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:52.858672 1708 tablet_copy_client.cc:538] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:52.862936 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:52.869347 30477 raft_consensus.cc:3055] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:52.869726 30477 raft_consensus.cc:740] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:52.870612 30477 consensus_queue.cc:260] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:52.872154 30477 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:52.867722 30487 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:52.880623 30539 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:52.881574 1717 raft_consensus.cc:2804] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:57:52.882803 30477 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:52.882822 1717 raft_consensus.cc:697] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:52.883972 1708 tablet_bootstrap.cc:492] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:52.884161 30317 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:52.885200 1476 raft_consensus.cc:2804] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:52.885768 1476 raft_consensus.cc:697] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:52.886042 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:52.886622 30582 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:52.887110 1476 consensus_queue.cc:237] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:52.893798 30582 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:57:52.897315 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:52.897941 30581 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:52.904934 30581 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:57:52.884238 1717 consensus_queue.cc:237] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:52.910553 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:52.911126 30367 raft_consensus.cc:3055] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:52.911408 30367 raft_consensus.cc:740] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:52.912102 30367 consensus_queue.cc:260] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:52.913117 30367 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:52.915098 30222 catalog_manager.cc:5697] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 3 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:52.965500 30590 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:52.969273 30582 raft_consensus.cc:1240] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:57:52.972210 30367 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:57:52.973369 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:52.974089 30590 raft_consensus.cc:3055] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:57:52.974365 30590 raft_consensus.cc:740] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:52.975226 30590 consensus_queue.cc:260] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:52.976504 30590 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:57:53.001906 1708 tablet_bootstrap.cc:492] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:53.003235 1708 tablet_bootstrap.cc:492] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:53.001186 30590 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
W20260807 07:57:53.010465 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 80710.2us
I20260807 07:57:53.018949 1708 ts_tablet_manager.cc:1403] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.135s user 0.018s sys 0.031s
I20260807 07:57:53.019558 30223 catalog_manager.cc:5697] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 4 to 5, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:53.040150 1708 raft_consensus.cc:359] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:53.042157 1708 raft_consensus.cc:740] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:53.043414 1708 consensus_queue.cc:260] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:53.063944 30222 catalog_manager.cc:5697] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 4, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 4 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:53.066937 1708 ts_tablet_manager.cc:1434] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.046s user 0.006s sys 0.000s
I20260807 07:57:53.071067 30605 tablet_copy_service.cc:342] P f831a53ec51d452398015797d543164e: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-9136a853c15441a6a0460d9da5efd3e9 received from {username='slave'} at 127.0.0.1:42218
I20260807 07:57:53.071519 30605 tablet_copy_service.cc:434] P f831a53ec51d452398015797d543164e: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-9136a853c15441a6a0460d9da5efd3e9 on tablet 9136a853c15441a6a0460d9da5efd3e9 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:53.075680 31383 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:57:53.077235 1730 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:57:53.125898 31383 raft_consensus.cc:1217] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6] Dedup: 7.6->[]
I20260807 07:57:53.141054 30367 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:57:53.144372 1702 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:57:53.241469 1539 raft_consensus.cc:1064] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:53.244084 1539 consensus_queue.cc:237] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:53.270467 31383 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 07:57:53.272138 1702 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:53.287596 31385 raft_consensus.cc:1217] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5] Dedup: 6.5->[]
I20260807 07:57:53.310959 31385 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEARNER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 07:57:53.316733 30578 raft_consensus.cc:1275] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:53.316923 1539 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260807 07:57:53.327636 30590 raft_consensus.cc:1275] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:57:53.327940 1476 consensus_queue.cc:1048] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:53.336704 30590 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 07:57:53.342000 30590 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 07:57:53.344556 30358 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 07:57:53.346033 1476 consensus_queue.cc:1048] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260807 07:57:53.361865 1702 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260807 07:57:53.374904 1742 log.cc:927] Time spent T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.074s user 0.000s sys 0.000s
I20260807 07:57:53.385224 1539 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:57:53.410295 1702 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:57:53.411193 30477 raft_consensus.cc:1275] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:57:53.420698 1297 consensus_queue.cc:1048] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:57:53.430243 30487 raft_consensus.cc:1275] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:53.431769 1297 consensus_queue.cc:1048] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:53.440702 30358 raft_consensus.cc:1275] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:57:53.484542 30489 raft_consensus.cc:1275] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260807 07:57:53.493129 1741 log.cc:927] Time spent T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.129s user 0.003s sys 0.000s
I20260807 07:57:53.505239 1715 consensus_queue.cc:1048] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:53.506901 1700 consensus_queue.cc:1048] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260807 07:57:53.562318 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 104591us
I20260807 07:57:53.570627 1695 raft_consensus.cc:2955] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:53.625413 1739 raft_consensus.cc:1064] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:53.628077 1739 consensus_queue.cc:237] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:53.631018 31383 raft_consensus.cc:2955] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:53.633769 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:53.642143 30369 raft_consensus.cc:2955] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:57:53.729038 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 121109us
I20260807 07:57:53.752451 1597 raft_consensus.cc:1064] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:53.822871 30221 catalog_manager.cc:5697] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:57:53.756896 1597 consensus_queue.cc:237] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:53.847524 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 78439.3us
I20260807 07:57:53.862198 31382 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 07:57:53.863853 1776 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:57:53.869067 30489 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 07:57:53.879523 1739 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260807 07:57:53.886605 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 95150.2us
I20260807 07:57:53.906790 30478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:53.907509 30478 raft_consensus.cc:606] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:53.925011 30367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:53.925642 30367 raft_consensus.cc:606] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:57:53.928653 30582 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 07:57:53.929875 30582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe6785f099494896ae258fd098deadc1"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:53.930382 30582 raft_consensus.cc:606] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:53.931699 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 07:57:53.933678 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:53.934414 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:53.964128 30582 raft_consensus.cc:2955] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:53.966275 1563 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:57:54.050866 31382 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 07:57:54.052276 30489 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 07:57:54.054541 1775 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:57:54.060443 30360 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 07:57:54.066663 1729 raft_consensus.cc:993] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:54.067319 1729 raft_consensus.cc:1081] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:54.069675 30578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:57:54.070188 30578 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:54.070637 30578 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:57:54.062125 1765 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260807 07:57:54.071929 1597 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:57:54.070106 1539 raft_consensus.cc:993] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:54.072996 1539 raft_consensus.cc:1081] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:54.093560 30578 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:54.099774 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:54.100373 30358 raft_consensus.cc:3055] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:57:54.100656 30358 raft_consensus.cc:740] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:54.101366 30358 consensus_queue.cc:260] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:54.160319 1563 raft_consensus.cc:2955] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.178520 30358 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:57:54.233624 30578 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:54.238452 30365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:54.239112 30365 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:54.239494 30365 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:54.239545 30487 consensus_queue.cc:237] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:54.244254 31382 raft_consensus.cc:2955] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.258638 30582 raft_consensus.cc:2955] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.260231 31383 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:57:54.262425 1764 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 07:57:54.268011 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:54.268586 30477 raft_consensus.cc:3060] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:57:54.280838 30477 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 9.
I20260807 07:57:54.292191 30358 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 9.
I20260807 07:57:54.295590 30539 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:54.301581 30365 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:54.309113 30582 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:57:54.319852 30365 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:54.308859 1775 raft_consensus.cc:2804] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election won for term 9
I20260807 07:57:54.323800 1775 raft_consensus.cc:697] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:54.329972 1715 raft_consensus.cc:993] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:54.330572 1715 raft_consensus.cc:1081] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:54.332660 1702 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 07:57:54.334250 1648 raft_consensus.cc:2955] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.336699 1784 raft_consensus.cc:2955] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.338835 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:54.339483 30582 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:54.325114 1775 consensus_queue.cc:237] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:54.348920 31383 raft_consensus.cc:2955] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.359175 30201 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5df190e0d6d146e8a2f82d090c06ecdf with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:57:54.358466 30590 raft_consensus.cc:2955] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.363943 30582 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:54.369271 30489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe6785f099494896ae258fd098deadc1"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:57:54.372254 30489 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:54.372614 30489 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:54.379751 30489 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:54.381283 30367 raft_consensus.cc:2955] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.382792 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:54.383507 30365 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
W20260807 07:57:54.386126 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 70357.7us
I20260807 07:57:54.386523 30578 raft_consensus.cc:1240] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 5. Current term is 6. Ops: []
I20260807 07:57:54.395885 30489 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:54.403375 30222 catalog_manager.cc:5697] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.398923 30320 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:54.406499 1764 consensus_queue.cc:1059] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:54.407718 1764 raft_consensus.cc:3055] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:54.407974 1729 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:54.408567 1729 raft_consensus.cc:697] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:54.409454 1729 consensus_queue.cc:237] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:54.411689 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:54.412081 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:54.415463 30578 raft_consensus.cc:3055] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:57:54.415766 30578 raft_consensus.cc:740] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:54.412515 30220 catalog_manager.cc:5697] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index 7 to 8, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:57:54.416605 30578 consensus_queue.cc:260] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:54.417719 30578 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:54.418483 30365 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:57:54.423549 1764 raft_consensus.cc:740] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:54.469141 1764 consensus_queue.cc:260] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:54.470701 1764 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:54.471645 30478 raft_consensus.cc:2955] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.430595 31382 raft_consensus.cc:2955] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.445956 30345 tablet_service.cc:1558] Processing DeleteTablet for tablet 5df190e0d6d146e8a2f82d090c06ecdf with delete_type TABLET_DATA_TOMBSTONED (TS b1188d7d3a0b455894bc443d571f6a19 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:45034
I20260807 07:57:54.454846 30489 raft_consensus.cc:2955] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.525264 30578 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:57:54.565256 30222 catalog_manager.cc:5697] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:57:54.580018 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 49158.9us
I20260807 07:57:54.605880 1806 tablet_replica.cc:333] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19: stopping tablet replica
I20260807 07:57:54.607020 1806 raft_consensus.cc:2243] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260807 07:57:54.607988 1806 raft_consensus.cc:2272] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260807 07:57:54.645961 1806 ts_tablet_manager.cc:1916] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:57:54.675827 30477 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:54.679230 30429 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:54.680087 1730 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:57:54.680589 1730 raft_consensus.cc:697] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:54.681646 1730 consensus_queue.cc:237] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:54.722662 30221 catalog_manager.cc:5697] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 5 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:54.744531 1806 ts_tablet_manager.cc:1929] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260807 07:57:54.745114 1806 log.cc:1199] T 5df190e0d6d146e8a2f82d090c06ecdf P b1188d7d3a0b455894bc443d571f6a19: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root/wals/5df190e0d6d146e8a2f82d090c06ecdf
I20260807 07:57:54.746891 30203 catalog_manager.cc:5028] TS b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): tablet 5df190e0d6d146e8a2f82d090c06ecdf (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:57:54.768673 30220 catalog_manager.cc:5697] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 6 to 7, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:54.797801 30367 consensus_queue.cc:237] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:54.810781 31383 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:57:54.812431 1776 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 07:57:54.826684 1563 raft_consensus.cc:2955] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.833547 31383 raft_consensus.cc:2955] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.842060 30477 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:57:54.845598 1476 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:57:54.850958 30477 raft_consensus.cc:2955] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.852895 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 37222025709f4384a02a9c633ee3190c with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260807 07:57:54.856042 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 325112us
I20260807 07:57:54.872923 30220 catalog_manager.cc:5697] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 8 to 9, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 9 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:54.887195 30221 catalog_manager.cc:5697] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 7 to 8, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.895385 30578 consensus_queue.cc:237] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:54.920923 30564 tablet_service.cc:1558] Processing DeleteTablet for tablet 37222025709f4384a02a9c633ee3190c with delete_type TABLET_DATA_TOMBSTONED (TS f831a53ec51d452398015797d543164e not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:34588
I20260807 07:57:54.931052 30478 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:54.932730 1476 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:54.942760 31383 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:57:54.947302 30365 raft_consensus.cc:1275] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260807 07:57:54.950500 1715 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:57:54.962105 30489 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:57:54.962175 1768 raft_consensus.cc:2955] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.967386 31382 raft_consensus.cc:2955] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:54.979055 30489 raft_consensus.cc:1275] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260807 07:57:54.997365 1819 tablet_replica.cc:333] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e: stopping tablet replica
I20260807 07:57:55.000679 1769 consensus_queue.cc:1048] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:57:55.032159 1813 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:57:55.044317 30582 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:55.078569 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9136a853c15441a6a0460d9da5efd3e9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260807 07:57:55.080511 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 48604.6us
I20260807 07:57:55.082484 1769 consensus_queue.cc:1048] T 75bed1078db6464388c6bf0bea4a4be6 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:57:55.088179 30477 raft_consensus.cc:2955] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:55.098057 30220 catalog_manager.cc:5697] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index 6 to 7, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:57:55.102934 1297 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:55.127121 30345 tablet_service.cc:1558] Processing DeleteTablet for tablet 9136a853c15441a6a0460d9da5efd3e9 with delete_type TABLET_DATA_TOMBSTONED (TS b1188d7d3a0b455894bc443d571f6a19 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:45034
I20260807 07:57:55.128134 1806 tablet_replica.cc:333] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19: stopping tablet replica
I20260807 07:57:55.129356 1806 raft_consensus.cc:2243] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260807 07:57:55.130291 1806 raft_consensus.cc:2272] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260807 07:57:55.146070 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:55.157440 1806 ts_tablet_manager.cc:1916] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:57:55.191524 1819 raft_consensus.cc:2243] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Raft consensus shutting down.
I20260807 07:57:55.194082 1819 raft_consensus.cc:2272] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260807 07:57:55.200016 1819 ts_tablet_manager.cc:1916] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:57:55.227350 30365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37222025709f4384a02a9c633ee3190c"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:55.228109 30365 raft_consensus.cc:606] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Received request to transfer leadership to TS 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:55.230909 30365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:55.231777 30365 raft_consensus.cc:606] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:55.239542 30365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:55.240159 30365 raft_consensus.cc:606] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:57:55.242933 30489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:55.243515 30489 raft_consensus.cc:606] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:55.246428 1819 ts_tablet_manager.cc:1929] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260807 07:57:55.246852 1819 log.cc:1199] T 37222025709f4384a02a9c633ee3190c P f831a53ec51d452398015797d543164e: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root/wals/37222025709f4384a02a9c633ee3190c
I20260807 07:57:55.248872 30489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:55.249507 30489 raft_consensus.cc:606] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:55.252178 30582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:55.252733 30582 raft_consensus.cc:606] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 8 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:55.254451 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260807 07:57:55.256276 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:55.257926 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:55.268039 30203 catalog_manager.cc:5028] TS f831a53ec51d452398015797d543164e (127.27.64.131:33207): tablet 37222025709f4384a02a9c633ee3190c (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:57:55.295516 30365 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:55.301105 30582 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:55.302671 1730 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:57:55.305477 1730 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:55.311169 1748 raft_consensus.cc:993] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:55.312405 1297 raft_consensus.cc:1081] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:55.313113 1563 raft_consensus.cc:993] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower 6bd20e9c0d3e4ace86fc1f55ab9425fa to start an election
I20260807 07:57:55.313614 1563 raft_consensus.cc:1081] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Signalling peer 6bd20e9c0d3e4ace86fc1f55ab9425fa to start an election
I20260807 07:57:55.314471 30590 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:57:55.315081 30590 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:55.315410 30590 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:55.318921 31382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37222025709f4384a02a9c633ee3190c"
dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
from {username='slave'} at 127.0.0.1:59320
I20260807 07:57:55.319504 31382 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:55.319828 31382 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:55.338375 31382 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:55.339118 1730 raft_consensus.cc:993] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:55.340895 1730 raft_consensus.cc:1081] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:55.342814 30360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:55.343202 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:55.343387 30360 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:55.343811 30358 raft_consensus.cc:3055] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:57:55.343822 30360 raft_consensus.cc:3060] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:55.344151 30358 raft_consensus.cc:740] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:55.344954 30358 consensus_queue.cc:260] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:55.346118 30358 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:55.355372 30358 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 8.
I20260807 07:57:55.356488 31338 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
I20260807 07:57:55.357471 1831 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:57:55.358012 1831 raft_consensus.cc:697] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:57:55.358824 1831 consensus_queue.cc:237] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:55.396395 1834 log.cc:927] Time spent T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260807 07:57:55.390394 30221 catalog_manager.cc:5697] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 7 to 8, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 8 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:57:55.375154 30360 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.408201 30360 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:55.384310 1769 raft_consensus.cc:993] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:55.410841 1769 raft_consensus.cc:1081] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 8 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:55.415905 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:55.417608 30582 raft_consensus.cc:3060] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:55.387795 30590 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.425447 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:55.431608 30478 raft_consensus.cc:3055] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Stepping down as leader of term 1
I20260807 07:57:55.431957 30478 raft_consensus.cc:740] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:55.432760 30478 consensus_queue.cc:260] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.433454 30590 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:55.434011 30478 raft_consensus.cc:3060] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 1 FOLLOWER]: Advancing to term 2
I20260807 07:57:55.435212 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:55.435827 30365 raft_consensus.cc:3055] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:55.436116 30365 raft_consensus.cc:740] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:55.438786 1806 ts_tablet_manager.cc:1929] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260807 07:57:55.439248 1806 log.cc:1199] T 9136a853c15441a6a0460d9da5efd3e9 P b1188d7d3a0b455894bc443d571f6a19: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root/wals/9136a853c15441a6a0460d9da5efd3e9
I20260807 07:57:55.437001 30365 consensus_queue.cc:260] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.441586 30477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:57:55.442245 30477 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:55.442579 30477 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:57:55.444201 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:55.446909 30489 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:55.447085 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:55.447692 30482 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:55.456008 30482 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:55.463325 1476 raft_consensus.cc:993] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:55.463804 1476 raft_consensus.cc:1081] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:55.465409 30482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:57:55.465929 30482 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:55.469775 30478 raft_consensus.cc:2468] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:55.466964 30477 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.472604 30477 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:55.473212 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:55.474010 30358 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:57:55.474668 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:55.475327 30585 raft_consensus.cc:3055] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:57:55.478543 30585 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:55.479390 30203 catalog_manager.cc:5028] TS b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): tablet 9136a853c15441a6a0460d9da5efd3e9 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:57:55.468050 30482 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:55.482720 30489 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 8.
I20260807 07:57:55.444491 31382 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:55.486784 30365 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:55.479476 30585 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.490527 30585 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:57:55.495077 30582 raft_consensus.cc:2468] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 2.
I20260807 07:57:55.497234 30585 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 9.
I20260807 07:57:55.478056 30317 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:55.483861 30358 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 9.
I20260807 07:57:55.503820 30429 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:55.503341 1776 raft_consensus.cc:2804] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 07:57:55.498742 30482 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.508802 1776 raft_consensus.cc:697] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:55.510080 30482 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:55.509752 1776 consensus_queue.cc:237] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.476205 30539 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:55.512897 1816 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 07:57:55.513710 1816 raft_consensus.cc:697] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:55.514549 1816 consensus_queue.cc:237] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.517498 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:55.518065 30585 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:55.524715 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:55.525231 30585 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
W20260807 07:57:55.527156 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 51036.9us
I20260807 07:57:55.527495 1769 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:55.528249 1769 raft_consensus.cc:697] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:55.525316 30358 raft_consensus.cc:3055] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:55.532773 30358 raft_consensus.cc:740] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:55.533461 1769 consensus_queue.cc:237] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.538926 30358 consensus_queue.cc:260] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.540493 30429 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:55.542831 30358 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:55.547451 1764 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:55.548573 1764 raft_consensus.cc:697] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:55.550298 1764 consensus_queue.cc:237] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.553781 30365 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:57:55.568853 30221 catalog_manager.cc:5697] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 5 to 6, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:55.594383 30220 catalog_manager.cc:5697] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 8 to 9, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 9 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:55.598102 1764 raft_consensus.cc:993] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:55.598692 1764 raft_consensus.cc:1081] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:55.604683 30365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:55.595466 30358 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:57:55.605288 30365 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:55.605791 30365 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:55.623239 30365 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.623706 30220 catalog_manager.cc:5697] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 1 to 2, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 2 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:55.629034 30221 catalog_manager.cc:5697] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 5 to 6, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:55.635407 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:55.635975 30585 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:55.634409 30365 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:55.635182 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:55.642733 30482 raft_consensus.cc:3055] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:57:55.643121 30482 raft_consensus.cc:740] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:55.645345 30482 consensus_queue.cc:260] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.648648 30482 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:57:55.643162 30585 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:57:55.653118 30320 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:55.654016 1776 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:57:55.654511 1776 raft_consensus.cc:697] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:55.655351 1776 consensus_queue.cc:237] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:55.661715 30482 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:57:55.701270 30220 catalog_manager.cc:5697] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 7 to 8, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 8 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:55.904465 30482 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:57:55.906177 1831 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:57:55.924109 30358 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260807 07:57:55.926548 1816 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:57:55.933454 30365 raft_consensus.cc:1275] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:55.938175 1813 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:55.942169 30590 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260807 07:57:55.943885 1816 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:57:55.946883 30489 raft_consensus.cc:1275] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:55.950511 1476 consensus_queue.cc:1048] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260807 07:57:55.952988 30585 raft_consensus.cc:1275] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:55.959933 1730 consensus_queue.cc:1048] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:55.995245 30360 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:57:56.003273 1842 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:57:56.081815 30482 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:57:56.087211 1563 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260807 07:57:56.144436 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 79655.4us
W20260807 07:57:56.224902 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 94843.2us
I20260807 07:57:56.282953 30366 raft_consensus.cc:1275] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:56.390738 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:56.414755 30578 raft_consensus.cc:1275] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 07:57:56.420320 30590 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:57:56.468693 30482 raft_consensus.cc:1275] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:56.477823 1748 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:57:56.521031 1769 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:57:56.509646 1873 consensus_queue.cc:1048] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:57:56.613898 1776 consensus_queue.cc:1048] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260807 07:57:56.679984 30360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:56.680877 30360 raft_consensus.cc:606] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:57:56.684600 30585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:56.685217 30585 raft_consensus.cc:606] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:56.686599 1748 raft_consensus.cc:993] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:56.688575 1748 raft_consensus.cc:1081] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:56.689038 30489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:56.689765 30489 raft_consensus.cc:606] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:56.692104 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 07:57:56.694254 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:56.705845 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:56.718923 30581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:57:56.719624 30581 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:56.719990 30581 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:56.728859 30581 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:56.731949 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:56.732709 30489 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:56.734027 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:56.734647 30360 raft_consensus.cc:3055] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:57:56.735059 30360 raft_consensus.cc:740] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:56.736405 30360 consensus_queue.cc:260] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:56.737567 30360 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:57:56.773667 30360 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:56.774169 30581 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:56.801890 30489 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:57:56.822096 30360 consensus_queue.cc:237] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:56.833487 30541 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:56.845674 1869 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:57:56.846252 1869 raft_consensus.cc:697] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:56.847152 1869 consensus_queue.cc:237] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:56.893929 30581 raft_consensus.cc:1275] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 07:57:56.895789 30489 raft_consensus.cc:1275] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260807 07:57:56.896595 30323 consensus_peers.cc:597] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dbbfdde9e309488aa336d6982fa31c49. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:57:56.902024 1883 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260807 07:57:56.905073 1872 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:56.922607 30220 catalog_manager.cc:5697] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e reported cstate change: term changed from 4 to 5, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 5 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:56.977926 1748 raft_consensus.cc:2955] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:56.987178 1859 raft_consensus.cc:993] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:56.987779 1859 raft_consensus.cc:1081] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:56.990113 30360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:56.990684 30360 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:56.991024 30360 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:56.989046 30489 raft_consensus.cc:2955] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:57.002085 30581 raft_consensus.cc:2955] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:57.016835 30360 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:57.034507 30360 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:57.035285 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:57.035888 30489 raft_consensus.cc:3055] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:57:57.036211 30489 raft_consensus.cc:740] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:57.037029 30489 consensus_queue.cc:260] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:57.039752 30489 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:57.045511 30222 catalog_manager.cc:5697] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:57.048827 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:57.065076 30581 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:57.051853 30585 consensus_queue.cc:237] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:57.074520 30581 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:57:57.076598 30320 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:57.077430 1883 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:57:57.077909 1883 raft_consensus.cc:697] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:57.078706 1883 consensus_queue.cc:237] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:57.065044 30489 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
W20260807 07:57:57.101464 30542 consensus_peers.cc:597] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dde7991fc81a4de2920445f4d2abe599. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:57:57.104521 30489 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:57.105846 30360 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:57.106729 1869 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:57.107795 1900 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:57.118964 1861 raft_consensus.cc:993] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:57.119436 1861 raft_consensus.cc:1081] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:57.121583 30489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:57:57.122120 30489 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:57.122443 30489 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:57.144912 1769 raft_consensus.cc:2955] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:57.183192 30477 raft_consensus.cc:2955] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:57.185070 30366 raft_consensus.cc:2955] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:57.196856 30489 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:57.200601 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:57.203977 30477 consensus_queue.cc:237] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:57.201960 30366 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:57.218911 30585 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260807 07:57:57.220340 30430 consensus_peers.cc:597] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dfc043461f2840a385956057685df8f9. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:57:57.221922 30360 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:57:57.223136 1887 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:57.226961 1857 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:57:57.231817 30489 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:57.240674 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:57.241303 30581 raft_consensus.cc:3055] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:57:57.241638 30581 raft_consensus.cc:740] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:57.242445 30581 consensus_queue.cc:260] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:57.243670 30581 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:57:57.246193 30366 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:57.248293 30429 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:57.251288 1873 raft_consensus.cc:2804] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:57:57.251778 1873 raft_consensus.cc:697] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:57.253636 30581 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:57:57.257958 1873 consensus_queue.cc:237] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:57.304247 1887 raft_consensus.cc:2955] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:57.308452 30220 catalog_manager.cc:5697] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 5 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:57.328713 30489 raft_consensus.cc:1275] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:57.330310 1769 consensus_queue.cc:1048] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:57.325629 30358 raft_consensus.cc:2955] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:57.346837 30579 raft_consensus.cc:2955] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:57.372563 30360 consensus_queue.cc:237] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:57.379248 30221 catalog_manager.cc:5697] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 6 to 7, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:57.401997 30222 catalog_manager.cc:5697] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 2 to 3, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:57.411854 30220 catalog_manager.cc:5697] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:57.422785 30366 raft_consensus.cc:1275] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:57:57.444139 1927 ts_tablet_manager.cc:933] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:57.429627 1861 consensus_queue.cc:1048] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
W20260807 07:57:57.473475 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 45433.2us
W20260807 07:57:57.481462 30323 consensus_peers.cc:597] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bca8ce0c4383454c82aca8ba08488278. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:57:57.486539 30487 raft_consensus.cc:1275] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 07:57:57.488144 1748 consensus_queue.cc:1048] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:57.510555 30579 raft_consensus.cc:1275] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 07:57:57.513712 1748 consensus_queue.cc:1048] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:57.558743 1872 raft_consensus.cc:2955] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:57.602385 30581 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:57.612334 1776 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:57.600512 30585 raft_consensus.cc:2955] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:57.642664 1927 tablet_copy_client.cc:323] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:57:57.652432 30383 tablet_copy_service.cc:140] P b1188d7d3a0b455894bc443d571f6a19: Received BeginTabletCopySession request for tablet dbbfdde9e309488aa336d6982fa31c49 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:33338)
I20260807 07:57:57.653512 30383 tablet_copy_service.cc:161] P b1188d7d3a0b455894bc443d571f6a19: Beginning new tablet copy session on tablet dbbfdde9e309488aa336d6982fa31c49 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:33338: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-dbbfdde9e309488aa336d6982fa31c49
I20260807 07:57:57.654595 30489 raft_consensus.cc:2955] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:57:57.666505 1937 ts_tablet_manager.cc:933] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:57.667977 30222 catalog_manager.cc:5697] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 2 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:57.676255 30383 tablet_copy_source_session.cc:215] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:57.689395 1927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbfdde9e309488aa336d6982fa31c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:57.701877 30489 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:57.703608 1883 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:57.707738 1937 tablet_copy_client.cc:323] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.131:33207
I20260807 07:57:57.710939 30605 tablet_copy_service.cc:140] P f831a53ec51d452398015797d543164e: Received BeginTabletCopySession request for tablet dde7991fc81a4de2920445f4d2abe599 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:42218)
I20260807 07:57:57.711551 30605 tablet_copy_service.cc:161] P f831a53ec51d452398015797d543164e: Beginning new tablet copy session on tablet dde7991fc81a4de2920445f4d2abe599 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:42218: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-dde7991fc81a4de2920445f4d2abe599
I20260807 07:57:57.719012 30585 raft_consensus.cc:1275] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:57:57.720912 1887 consensus_queue.cc:1048] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:57.767218 30358 raft_consensus.cc:1275] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:57:57.769349 1857 consensus_queue.cc:1048] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:57:57.773747 30605 tablet_copy_source_session.cc:215] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:57.818082 1927 tablet_copy_client.cc:806] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:57.818933 1927 tablet_copy_client.cc:670] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:57.843796 1927 tablet_copy_client.cc:538] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:57.859668 1937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde7991fc81a4de2920445f4d2abe599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:57.864295 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:57.885784 1943 ts_tablet_manager.cc:933] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:57.932979 1937 tablet_copy_client.cc:806] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:57.933864 1937 tablet_copy_client.cc:670] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:57.965791 1937 tablet_copy_client.cc:538] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:58.022656 1927 tablet_bootstrap.cc:492] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:58.014312 1943 tablet_copy_client.cc:323] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
I20260807 07:57:58.077581 1950 ts_tablet_manager.cc:933] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:57:58.081142 30502 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet dfc043461f2840a385956057685df8f9 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
I20260807 07:57:58.081837 30502 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet dfc043461f2840a385956057685df8f9 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-dfc043461f2840a385956057685df8f9
I20260807 07:57:58.083634 1937 tablet_bootstrap.cc:492] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:58.088884 1950 tablet_copy_client.cc:323] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:57:58.091475 30502 tablet_copy_source_session.cc:215] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:58.098268 30383 tablet_copy_service.cc:140] P b1188d7d3a0b455894bc443d571f6a19: Received BeginTabletCopySession request for tablet bca8ce0c4383454c82aca8ba08488278 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:33338)
I20260807 07:57:58.111373 30383 tablet_copy_service.cc:161] P b1188d7d3a0b455894bc443d571f6a19: Beginning new tablet copy session on tablet bca8ce0c4383454c82aca8ba08488278 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:33338: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-bca8ce0c4383454c82aca8ba08488278
I20260807 07:57:58.119400 1943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc043461f2840a385956057685df8f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:58.129535 30383 tablet_copy_source_session.cc:215] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:57:58.132844 1950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bca8ce0c4383454c82aca8ba08488278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:57:58.176745 1950 tablet_copy_client.cc:806] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:58.189049 1950 tablet_copy_client.cc:670] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:58.200222 1950 tablet_copy_client.cc:538] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:58.208470 1937 tablet_bootstrap.cc:492] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:58.209538 1937 tablet_bootstrap.cc:492] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:58.210325 1937 ts_tablet_manager.cc:1403] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.127s user 0.027s sys 0.008s
I20260807 07:57:58.236768 1950 tablet_bootstrap.cc:492] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:58.244505 1937 raft_consensus.cc:359] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:58.244364 1943 tablet_copy_client.cc:806] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:57:58.259675 1943 tablet_copy_client.cc:670] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:57:58.263890 1943 tablet_copy_client.cc:538] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:57:58.259238 1937 raft_consensus.cc:740] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:58.268769 1937 consensus_queue.cc:260] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:58.271903 1937 ts_tablet_manager.cc:1434] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.061s user 0.005s sys 0.001s
I20260807 07:57:58.278415 1927 tablet_bootstrap.cc:492] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:58.279441 1927 tablet_bootstrap.cc:492] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:58.280241 1927 ts_tablet_manager.cc:1403] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.258s user 0.037s sys 0.037s
I20260807 07:57:58.284642 30489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:57:58.285228 30489 raft_consensus.cc:606] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:57:58.287482 30605 tablet_copy_service.cc:342] P f831a53ec51d452398015797d543164e: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-dde7991fc81a4de2920445f4d2abe599 received from {username='slave'} at 127.0.0.1:42218
I20260807 07:57:58.287942 30605 tablet_copy_service.cc:434] P f831a53ec51d452398015797d543164e: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-dde7991fc81a4de2920445f4d2abe599 on tablet dde7991fc81a4de2920445f4d2abe599 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:58.313934 30585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:57:58.340073 30585 raft_consensus.cc:606] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:57:58.343768 1943 tablet_bootstrap.cc:492] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:57:58.347087 30358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:57:58.347707 30358 raft_consensus.cc:606] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:57:58.351694 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 07:57:58.353478 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:57:58.354218 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:58.355549 1861 raft_consensus.cc:993] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:58.356074 1861 raft_consensus.cc:1081] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:57:58.358009 30489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:57:58.358762 30489 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:58.359094 30489 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:58.368134 1950 tablet_bootstrap.cc:492] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:58.369153 1950 tablet_bootstrap.cc:492] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:58.384521 1950 ts_tablet_manager.cc:1403] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.148s user 0.027s sys 0.000s
I20260807 07:57:58.400327 1950 raft_consensus.cc:359] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:58.403635 1950 raft_consensus.cc:740] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:58.404403 1950 consensus_queue.cc:260] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:58.379674 1887 raft_consensus.cc:993] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:58.369534 1927 raft_consensus.cc:359] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:58.378433 30489 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:58.434996 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:58.435657 30358 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:58.436360 30489 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:58.437927 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:58.438422 30585 raft_consensus.cc:3055] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:57:58.438757 30585 raft_consensus.cc:740] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:58.424553 1857 raft_consensus.cc:1081] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:57:58.429540 1927 raft_consensus.cc:740] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:58.441828 31383 raft_consensus.cc:1217] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260807 07:57:58.445814 1950 ts_tablet_manager.cc:1434] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.061s user 0.005s sys 0.002s
I20260807 07:57:58.439469 30585 consensus_queue.cc:260] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:58.450887 30585 raft_consensus.cc:3060] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:58.476516 1927 consensus_queue.cc:260] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:58.486025 1927 ts_tablet_manager.cc:1434] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.205s user 0.007s sys 0.000s
I20260807 07:57:58.500737 30585 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:57:58.505779 30358 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:57:58.512769 30383 tablet_copy_service.cc:342] P b1188d7d3a0b455894bc443d571f6a19: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-bca8ce0c4383454c82aca8ba08488278 received from {username='slave'} at 127.0.0.1:33338
I20260807 07:57:58.513274 30383 tablet_copy_service.cc:434] P b1188d7d3a0b455894bc443d571f6a19: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-bca8ce0c4383454c82aca8ba08488278 on tablet bca8ce0c4383454c82aca8ba08488278 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:58.514815 30386 tablet_copy_service.cc:342] P b1188d7d3a0b455894bc443d571f6a19: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-dbbfdde9e309488aa336d6982fa31c49 received from {username='slave'} at 127.0.0.1:33338
I20260807 07:57:58.515244 30386 tablet_copy_service.cc:434] P b1188d7d3a0b455894bc443d571f6a19: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-dbbfdde9e309488aa336d6982fa31c49 on tablet dbbfdde9e309488aa336d6982fa31c49 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:58.530422 30429 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:58.534109 30365 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:57:58.542544 1887 raft_consensus.cc:2804] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:57:58.543133 1887 raft_consensus.cc:697] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:58.544004 1887 consensus_queue.cc:237] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:58.538563 30365 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:58.546113 30365 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:58.576728 1943 tablet_bootstrap.cc:492] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:57:58.580315 1776 raft_consensus.cc:993] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:58.594316 1776 raft_consensus.cc:1081] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:57:58.597107 30581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:57:58.597673 30581 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:57:58.597988 30581 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:58.602859 30365 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:58.610106 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:58.610680 30489 raft_consensus.cc:3055] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:57:58.610954 30489 raft_consensus.cc:740] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:57:58.611723 30489 consensus_queue.cc:260] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:58.605118 30581 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:58.614610 30581 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:57:58.611974 1943 tablet_bootstrap.cc:492] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:57:58.615952 1943 ts_tablet_manager.cc:1403] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.279s user 0.049s sys 0.035s
I20260807 07:57:58.617944 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:57:58.618579 30360 raft_consensus.cc:3055] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:57:58.618861 30360 raft_consensus.cc:740] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:58.619360 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:57:58.619557 30360 consensus_queue.cc:260] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:58.619961 30487 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:58.620657 30360 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:57:58.612792 30489 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:58.637117 30487 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:57:58.645779 30539 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:57:58.646700 1861 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:57:58.647315 1861 raft_consensus.cc:697] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:57:58.648392 1861 consensus_queue.cc:237] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:58.654337 30360 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:57:58.662163 30489 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:58.674805 30317 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:57:58.676952 1776 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:57:58.677496 1776 raft_consensus.cc:697] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:57:58.683139 30365 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:57:58.685791 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:57:58.686774 30581 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:57:58.678759 1776 consensus_queue.cc:237] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:57:58.697070 30581 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:57:58.707788 30222 catalog_manager.cc:5697] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 6 to 7, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 7 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:57:58.717025 1943 raft_consensus.cc:359] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:58.727933 1943 raft_consensus.cc:740] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:57:58.773097 1943 consensus_queue.cc:260] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:57:58.817551 31383 raft_consensus.cc:1217] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4] Dedup: 5.4->[]
I20260807 07:57:58.837198 30220 catalog_manager.cc:5697] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 6 to 7, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:58.842679 30223 catalog_manager.cc:5697] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 5 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:57:58.847303 31383 raft_consensus.cc:1217] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3] Dedup: 3.3->[]
I20260807 07:57:58.849277 1943 ts_tablet_manager.cc:1434] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.233s user 0.009s sys 0.000s
I20260807 07:57:58.861652 30502 tablet_copy_service.cc:342] P ef1ca7acf52a438f89f14707e9e06818: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-dfc043461f2840a385956057685df8f9 received from {username='slave'} at 127.0.0.1:34358
I20260807 07:57:58.862135 30502 tablet_copy_service.cc:434] P ef1ca7acf52a438f89f14707e9e06818: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-dfc043461f2840a385956057685df8f9 on tablet dfc043461f2840a385956057685df8f9 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:57:58.882514 31385 raft_consensus.cc:1217] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
I20260807 07:57:59.007321 1964 raft_consensus.cc:1064] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:57:59.009977 1964 consensus_queue.cc:237] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:59.058260 31383 raft_consensus.cc:1275] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 07:57:59.059993 1975 consensus_queue.cc:1048] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:59.068992 30581 raft_consensus.cc:1275] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 07:57:59.079499 30489 raft_consensus.cc:1275] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 07:57:59.092959 1973 consensus_queue.cc:1048] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:59.109086 30360 raft_consensus.cc:1275] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:59.123040 1973 consensus_queue.cc:1048] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:59.133059 30487 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:59.136617 1887 consensus_queue.cc:1048] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:59.139447 30365 raft_consensus.cc:1275] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:59.146763 30590 raft_consensus.cc:1275] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:59.168372 1964 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260807 07:57:59.189558 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 43638.8us
I20260807 07:57:59.225193 30590 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:57:59.222384 1861 consensus_queue.cc:1048] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260807 07:57:59.239653 1776 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:59.249787 1959 consensus_queue.cc:1048] T 78ad63a77c6546d6bc5db4234526fc78 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:57:59.240017 1972 raft_consensus.cc:2955] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:59.245066 30482 raft_consensus.cc:2955] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:59.261577 30489 raft_consensus.cc:1275] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:57:59.272179 1861 consensus_queue.cc:1048] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
W20260807 07:57:59.310727 1987 log.cc:927] Time spent T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.117s user 0.001s sys 0.000s
I20260807 07:57:59.319546 31383 raft_consensus.cc:2955] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:59.327900 30579 raft_consensus.cc:2955] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:59.333523 1930 raft_consensus.cc:1064] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
W20260807 07:57:59.405423 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 46003.4us
I20260807 07:57:59.471853 1996 raft_consensus.cc:1064] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
W20260807 07:57:59.488683 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 66980.6us
W20260807 07:57:59.489095 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 70114.4us
I20260807 07:57:59.518255 1975 raft_consensus.cc:1064] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
W20260807 07:57:59.526957 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 102856us
I20260807 07:57:59.547946 1975 consensus_queue.cc:237] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:57:59.550822 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 83208.7us
W20260807 07:57:59.563512 1998 log.cc:927] Time spent T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.184s user 0.003s sys 0.000s
I20260807 07:57:59.521188 1996 consensus_queue.cc:237] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:59.642023 1930 consensus_queue.cc:237] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:57:59.557736 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:57:59.666532 31383 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 07:57:59.671141 1996 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:59.674526 30358 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 07:57:59.676631 1887 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:57:59.676275 30223 catalog_manager.cc:5697] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:59.701306 30487 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:57:59.711946 1969 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260807 07:57:59.716768 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 88660.7us
I20260807 07:57:59.719560 31384 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:57:59.737900 31383 raft_consensus.cc:1275] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:59.741631 30586 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260807 07:57:59.742970 1977 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:57:59.754096 30489 raft_consensus.cc:1275] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:59.755432 2003 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:57:59.760160 30360 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:57:59.762992 2010 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:57:59.782284 30585 raft_consensus.cc:1275] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260807 07:57:59.787470 1932 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260807 07:57:59.783155 1973 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260807 07:57:59.816404 1996 raft_consensus.cc:2955] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:59.821657 30358 raft_consensus.cc:2955] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:59.834497 1883 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260807 07:57:59.884159 30585 raft_consensus.cc:2955] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:59.913738 31385 raft_consensus.cc:2955] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:59.961843 1769 raft_consensus.cc:2955] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:59.971266 1883 raft_consensus.cc:2955] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:59.978263 30489 raft_consensus.cc:2955] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:59.980429 30478 raft_consensus.cc:2955] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:57:59.999419 31385 raft_consensus.cc:2955] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.006572 30360 raft_consensus.cc:2955] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.029731 30221 catalog_manager.cc:5697] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.031232 30358 consensus_queue.cc:237] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:00.044647 31382 raft_consensus.cc:1275] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 07:58:00.046243 1883 consensus_queue.cc:1048] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:00.054667 2016 raft_consensus.cc:2955] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.062186 31382 raft_consensus.cc:2955] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.073647 30579 raft_consensus.cc:2955] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.085919 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bca8ce0c4383454c82aca8ba08488278 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:58:00.086426 30585 raft_consensus.cc:1275] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 07:58:00.087582 31383 raft_consensus.cc:2955] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.092924 2025 consensus_queue.cc:1048] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:58:00.101665 30223 catalog_manager.cc:5697] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:00.112365 30585 raft_consensus.cc:2955] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.141484 30581 consensus_queue.cc:237] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:00.159574 30578 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:00.160171 30578 raft_consensus.cc:606] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:00.162024 30478 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:58:00.162074 31382 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:58:00.164507 1769 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:00.168715 30222 catalog_manager.cc:5697] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.170701 1861 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:00.176695 2024 raft_consensus.cc:2955] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.182690 30360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:00.182060 30478 raft_consensus.cc:2955] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.183274 30360 raft_consensus.cc:606] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 9 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:00.187104 30489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfc043461f2840a385956057685df8f9"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:00.187659 30489 raft_consensus.cc:606] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:00.199849 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dde7991fc81a4de2920445f4d2abe599 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:58:00.201762 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 07:58:00.203578 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:00.207435 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
W20260807 07:58:00.209951 30201 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 13 similar messages]
I20260807 07:58:00.226182 31382 raft_consensus.cc:2955] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:58:00.235847 30203 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet dde7991fc81a4de2920445f4d2abe599 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f831a53ec51d452398015797d543164e (127.27.64.131:33207) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 5 but the committed config has opid_index of 6
I20260807 07:58:00.235389 30223 catalog_manager.cc:5697] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index 4 to 5, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New cstate: current_term: 2 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260807 07:58:00.249688 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 74623.7us
I20260807 07:58:00.262645 30360 consensus_queue.cc:237] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:00.273687 31382 raft_consensus.cc:1275] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 07:58:00.280534 2016 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:00.291179 1883 raft_consensus.cc:2955] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.297914 31382 raft_consensus.cc:2955] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.257485 30222 catalog_manager.cc:5697] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index 5 to 6, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New cstate: current_term: 5 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:00.326334 30223 catalog_manager.cc:5697] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 5 to 6, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New cstate: current_term: 3 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.337869 30345 tablet_service.cc:1558] Processing DeleteTablet for tablet dde7991fc81a4de2920445f4d2abe599 with delete_type TABLET_DATA_TOMBSTONED (TS b1188d7d3a0b455894bc443d571f6a19 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45034
I20260807 07:58:00.342514 2047 tablet_replica.cc:333] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19: stopping tablet replica
W20260807 07:58:00.351058 30201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 141228us
I20260807 07:58:00.361030 30581 raft_consensus.cc:1275] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 07:58:00.366499 2047 raft_consensus.cc:2243] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:00.367033 30459 tablet_service.cc:1558] Processing DeleteTablet for tablet bca8ce0c4383454c82aca8ba08488278 with delete_type TABLET_DATA_TOMBSTONED (TS ef1ca7acf52a438f89f14707e9e06818 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33906
I20260807 07:58:00.367748 2047 raft_consensus.cc:2272] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:00.368526 30458 tablet_service.cc:1558] Processing DeleteTablet for tablet dbbfdde9e309488aa336d6982fa31c49 with delete_type TABLET_DATA_TOMBSTONED (TS ef1ca7acf52a438f89f14707e9e06818 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:33906
I20260807 07:58:00.375649 1996 raft_consensus.cc:993] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:00.376154 1996 raft_consensus.cc:1081] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
W20260807 07:58:00.375512 30201 catalog_manager.cc:4755] TS ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): ChangeConfig:REMOVE_PEER RPC failed for tablet dfc043461f2840a385956057685df8f9: Remote error: Service unavailable: leader transfer in progress
I20260807 07:58:00.380055 30360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfc043461f2840a385956057685df8f9"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:00.380600 30360 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:00.380929 30360 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:00.388686 2047 ts_tablet_manager.cc:1916] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:00.399475 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dbbfdde9e309488aa336d6982fa31c49 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:58:00.403280 2016 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:00.410527 2048 tablet_replica.cc:333] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818: stopping tablet replica
I20260807 07:58:00.411878 2048 raft_consensus.cc:2243] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:00.412786 2048 raft_consensus.cc:2272] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:00.413771 30581 raft_consensus.cc:2955] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.416077 2048 ts_tablet_manager.cc:1916] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:00.436383 30360 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:00.456687 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:00.457267 30579 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:00.459376 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:00.459964 30478 raft_consensus.cc:3055] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:58:00.460248 30478 raft_consensus.cc:740] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:00.464504 30579 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:58:00.464674 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:00.465314 31382 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:00.471988 30360 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:00.460955 30478 consensus_queue.cc:260] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:00.474128 30478 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:00.495116 31382 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:58:00.496990 30478 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:58:00.498395 30317 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:00.499159 2016 raft_consensus.cc:2804] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:58:00.499676 2016 raft_consensus.cc:697] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:00.500622 2016 consensus_queue.cc:237] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:00.502962 30201 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet dfc043461f2840a385956057685df8f9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ef1ca7acf52a438f89f14707e9e06818 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:00.513995 2047 ts_tablet_manager.cc:1929] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260807 07:58:00.514591 2047 log.cc:1199] T dde7991fc81a4de2920445f4d2abe599 P b1188d7d3a0b455894bc443d571f6a19: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root/wals/dde7991fc81a4de2920445f4d2abe599
I20260807 07:58:00.523615 30203 catalog_manager.cc:5028] TS b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): tablet dde7991fc81a4de2920445f4d2abe599 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:00.523907 30222 catalog_manager.cc:5697] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 3 to 4, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 4 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:00.539345 2048 ts_tablet_manager.cc:1929] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260807 07:58:00.543020 2048 log.cc:1199] T bca8ce0c4383454c82aca8ba08488278 P ef1ca7acf52a438f89f14707e9e06818: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root/wals/bca8ce0c4383454c82aca8ba08488278
I20260807 07:58:00.556036 2048 tablet_replica.cc:333] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818: stopping tablet replica
I20260807 07:58:00.556527 30201 catalog_manager.cc:5028] TS ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): tablet bca8ce0c4383454c82aca8ba08488278 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:00.558112 2048 raft_consensus.cc:2243] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:00.559111 2048 raft_consensus.cc:2272] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:00.563601 2048 ts_tablet_manager.cc:1916] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:00.613335 2048 ts_tablet_manager.cc:1929] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260807 07:58:00.613791 2048 log.cc:1199] T dbbfdde9e309488aa336d6982fa31c49 P ef1ca7acf52a438f89f14707e9e06818: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root/wals/dbbfdde9e309488aa336d6982fa31c49
I20260807 07:58:00.616729 30201 catalog_manager.cc:5028] TS ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): tablet dbbfdde9e309488aa336d6982fa31c49 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:00.694665 2016 raft_consensus.cc:993] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:00.695250 1883 raft_consensus.cc:1081] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 9 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:00.696870 30581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:58:00.697449 30581 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:00.697811 30581 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:00.704829 30581 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:00.707401 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:00.707625 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:00.708009 30360 raft_consensus.cc:3055] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 9 LEADER]: Stepping down as leader of term 9
I20260807 07:58:00.708258 30489 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:00.708367 30360 raft_consensus.cc:740] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:00.709219 30360 consensus_queue.cc:260] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:00.710338 30360 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:00.713881 30581 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:00.716655 30489 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 10.
I20260807 07:58:00.717907 30539 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:00.718874 2024 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader election won for term 10
I20260807 07:58:00.719429 2024 raft_consensus.cc:697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 10 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:00.720286 2024 consensus_queue.cc:237] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:00.728515 30360 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 10.
I20260807 07:58:00.747576 1861 raft_consensus.cc:993] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:00.748221 1969 raft_consensus.cc:1081] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:00.750923 30482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:58:00.751495 30482 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:00.751845 30482 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:00.759393 30482 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:00.761370 30482 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:00.762467 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:00.762902 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:00.763115 30581 raft_consensus.cc:3055] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:00.763454 30581 raft_consensus.cc:740] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:00.763473 30360 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:00.764241 30581 consensus_queue.cc:260] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:00.765502 30581 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:00.772197 30581 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:00.773099 30360 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:00.773635 30429 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:00.775063 2003 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:00.775565 2003 raft_consensus.cc:697] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:00.776522 2003 consensus_queue.cc:237] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:00.800801 30222 catalog_manager.cc:5697] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 6 to 7, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:00.804505 30223 catalog_manager.cc:5697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 9 to 10, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 10 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:58:00.908130 30581 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:58:00.911918 1883 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:00.933236 30482 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:58:00.934990 2049 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260807 07:58:01.042065 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 52446.9us
I20260807 07:58:01.104943 31382 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:58:01.110728 2049 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:01.135329 30360 consensus_queue.cc:237] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:01.142205 30478 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 07:58:01.143855 2016 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:01.167815 30578 raft_consensus.cc:1275] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:01.168291 30478 raft_consensus.cc:2955] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:01.171321 1873 consensus_queue.cc:1048] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:01.195835 30223 catalog_manager.cc:5697] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index 4 to 6, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New cstate: current_term: 4 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:01.213878 30564 tablet_service.cc:1558] Processing DeleteTablet for tablet dfc043461f2840a385956057685df8f9 with delete_type TABLET_DATA_TOMBSTONED (TS f831a53ec51d452398015797d543164e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34588
I20260807 07:58:01.223153 2025 raft_consensus.cc:2955] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:01.277746 30478 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260807 07:58:01.298792 30358 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260807 07:58:01.303655 2070 tablet_replica.cc:333] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e: stopping tablet replica
I20260807 07:58:01.312259 2024 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:58:01.314646 2070 raft_consensus.cc:2243] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:01.323360 2070 raft_consensus.cc:2272] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:01.317672 2024 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:58:01.340540 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dfc043461f2840a385956057685df8f9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 6)
I20260807 07:58:01.376314 2070 ts_tablet_manager.cc:1916] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260807 07:58:01.387511 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 57448us
I20260807 07:58:01.393050 31385 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 07:58:01.393050 30358 raft_consensus.cc:1275] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:01.402245 2025 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:01.407734 31385 raft_consensus.cc:2955] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:01.462924 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:01.469715 2003 consensus_queue.cc:1048] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:01.629621 2070 ts_tablet_manager.cc:1929] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260807 07:58:01.630131 2070 log.cc:1199] T dfc043461f2840a385956057685df8f9 P f831a53ec51d452398015797d543164e: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root/wals/dfc043461f2840a385956057685df8f9
I20260807 07:58:01.632033 30203 catalog_manager.cc:5028] TS f831a53ec51d452398015797d543164e (127.27.64.131:33207): tablet dfc043461f2840a385956057685df8f9 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:01.727638 30579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15fa23df425445ce99709045bc6e9789"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:01.728251 30579 raft_consensus.cc:606] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Received request to transfer leadership to TS 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:01.733500 30360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:01.734068 30360 raft_consensus.cc:606] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:01.738437 30360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:01.738968 30360 raft_consensus.cc:606] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Received request to transfer leadership to TS 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:01.741756 30487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe6785f099494896ae258fd098deadc1"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:01.742304 30487 raft_consensus.cc:606] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:01.744422 2079 raft_consensus.cc:993] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:01.744859 2079 raft_consensus.cc:1081] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:01.753325 30358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe6785f099494896ae258fd098deadc1"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:01.753909 30358 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:01.754249 30358 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:01.761917 30487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:01.762539 30487 raft_consensus.cc:606] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:01.763803 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 07:58:01.767409 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:01.769290 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:01.773155 30358 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:01.795663 30358 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:01.797150 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:01.797787 30579 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:01.798861 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:01.799438 30487 raft_consensus.cc:3055] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:01.799742 30487 raft_consensus.cc:740] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:01.800462 30487 consensus_queue.cc:260] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:01.801771 30487 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:01.809700 30487 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:01.812767 30579 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:01.818707 30317 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:01.819932 2025 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:01.820420 2025 raft_consensus.cc:697] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:01.821276 2025 consensus_queue.cc:237] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:01.850517 30221 catalog_manager.cc:5697] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 7 to 8, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 8 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:01.976011 2024 raft_consensus.cc:993] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e: : Instructing follower 6bd20e9c0d3e4ace86fc1f55ab9425fa to start an election
I20260807 07:58:01.976516 2024 raft_consensus.cc:1081] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Signalling peer 6bd20e9c0d3e4ace86fc1f55ab9425fa to start an election
I20260807 07:58:01.979269 31385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15fa23df425445ce99709045bc6e9789"
dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
from {username='slave'} at 127.0.0.1:59394
I20260807 07:58:01.979802 31385 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:01.980104 31385 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:02.021296 31385 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:02.026937 1776 raft_consensus.cc:993] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:02.035708 1776 raft_consensus.cc:1081] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:02.038456 30581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:58:02.039017 30581 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:02.039354 30581 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:58:02.086647 30581 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:02.104724 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:02.108517 30358 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:02.120640 30358 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 5.
I20260807 07:58:02.121872 31338 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
I20260807 07:58:02.122720 2057 raft_consensus.cc:2804] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:58:02.123253 2057 raft_consensus.cc:697] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:02.124087 2057 consensus_queue.cc:237] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:02.127035 2049 raft_consensus.cc:993] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower 6bd20e9c0d3e4ace86fc1f55ab9425fa to start an election
I20260807 07:58:02.127530 2049 raft_consensus.cc:1081] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Signalling peer 6bd20e9c0d3e4ace86fc1f55ab9425fa to start an election
I20260807 07:58:02.129770 31382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49"
dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
from {username='slave'} at 127.0.0.1:59320
I20260807 07:58:02.130314 31382 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:02.130687 31382 raft_consensus.cc:3060] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:02.141700 1873 raft_consensus.cc:993] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:02.142252 1873 raft_consensus.cc:1081] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:02.155256 30358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:02.155834 30358 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:02.156184 30358 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:02.174475 30358 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:02.184369 30358 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:02.184584 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:02.185206 30478 raft_consensus.cc:3055] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Stepping down as leader of term 9
I20260807 07:58:02.185513 30478 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:02.186211 30478 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:02.187325 30478 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:02.197767 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:02.198356 30578 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:02.205462 30578 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 10.
I20260807 07:58:02.235526 30320 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:02.238686 1776 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 07:58:02.239152 1776 raft_consensus.cc:697] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 10 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:02.239912 1776 consensus_queue.cc:237] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:02.264997 30221 catalog_manager.cc:5697] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 4 to 5, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 5 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:02.104724 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:02.328341 30579 raft_consensus.cc:3055] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:58:02.328713 30579 raft_consensus.cc:740] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
W20260807 07:58:02.328953 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 72522.6us
I20260807 07:58:02.329533 30579 consensus_queue.cc:260] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:02.330832 30579 raft_consensus.cc:3060] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:02.334759 30482 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:58:02.337086 2087 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:02.103309 31385 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:02.285506 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:02.344900 30579 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 5.
I20260807 07:58:02.345220 30487 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:58:02.285987 30581 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:02.290524 31382 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:02.355741 30487 raft_consensus.cc:2468] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:58:02.314376 30478 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 10.
I20260807 07:58:02.362488 30539 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:02.366016 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:02.366736 30360 raft_consensus.cc:3055] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:58:02.367044 30360 raft_consensus.cc:740] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:02.367825 30360 consensus_queue.cc:260] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:02.371160 31382 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:02.372233 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:02.372870 30581 raft_consensus.cc:3060] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:02.377696 30360 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:58:02.383731 30223 catalog_manager.cc:5697] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 9 to 10, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 10 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
W20260807 07:58:02.391073 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:02.410540 30581 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 4.
I20260807 07:58:02.411752 31338 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:02.413481 30360 raft_consensus.cc:2468] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:58:02.414351 30581 raft_consensus.cc:1240] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 3. Current term is 4. Ops: []
I20260807 07:58:02.415174 30585 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260807 07:58:02.418437 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 135234us
I20260807 07:58:02.408740 2024 raft_consensus.cc:2804] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:58:02.426076 2057 raft_consensus.cc:2804] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:58:02.426599 2057 raft_consensus.cc:697] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:02.427465 2057 consensus_queue.cc:237] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:02.430950 2024 raft_consensus.cc:697] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:02.431912 2024 consensus_queue.cc:237] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:02.453011 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:02.453722 30360 raft_consensus.cc:3055] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:58:02.454015 30360 raft_consensus.cc:740] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:02.454735 30360 consensus_queue.cc:260] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:02.460686 2089 consensus_queue.cc:1059] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:02.465914 30360 raft_consensus.cc:3060] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:02.472599 30358 consensus_queue.cc:237] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:58:02.476198 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 140496us
I20260807 07:58:02.475713 30360 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 4.
I20260807 07:58:02.508770 30223 catalog_manager.cc:5697] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 3 to 4, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 4 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:02.476725 2089 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260807 07:58:02.546479 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 44487.8us
W20260807 07:58:02.594673 30323 consensus_peers.cc:597] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0eeea67c5e49472292549e65f2c9e844. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:58:02.604931 30223 catalog_manager.cc:5697] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 2 to 3, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 3 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:58:02.625303 30585 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 07:58:02.628364 2025 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:02.660897 30489 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 07:58:02.668072 2109 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:02.669411 30579 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260807 07:58:02.674369 30579 raft_consensus.cc:1275] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:58:02.676839 2109 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:02.678085 2096 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:02.678244 2049 raft_consensus.cc:2955] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:02.683197 30489 raft_consensus.cc:2955] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:02.687979 30487 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260807 07:58:02.689951 30367 raft_consensus.cc:1275] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:58:02.691341 2096 consensus_queue.cc:1048] T 15fa23df425445ce99709045bc6e9789 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:02.703271 2087 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260807 07:58:02.723342 30220 catalog_manager.cc:5697] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:02.774412 30585 raft_consensus.cc:2955] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:02.810067 30489 consensus_queue.cc:237] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:02.838361 30358 raft_consensus.cc:1275] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 07:58:02.839830 1866 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260807 07:58:02.903707 30430 consensus_peers.cc:597] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 24224c3e18ec49578bb6c7bd4fd217b5. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:58:02.913681 30585 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:58:02.915114 2079 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:02.921861 30487 raft_consensus.cc:1275] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:58:02.923427 1861 consensus_queue.cc:1048] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:58:02.958875 30367 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:58:02.961010 2079 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:02.986079 30360 raft_consensus.cc:1275] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260807 07:58:02.989728 30579 raft_consensus.cc:1275] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 07:58:02.991829 1866 consensus_queue.cc:1048] T dbbfdde9e309488aa336d6982fa31c49 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:03.001875 2101 consensus_queue.cc:1048] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260807 07:58:03.054123 2098 raft_consensus.cc:2955] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:03.062047 30367 raft_consensus.cc:2955] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:03.096131 30222 catalog_manager.cc:5697] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:03.099403 30489 consensus_queue.cc:237] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:03.114413 30585 raft_consensus.cc:2955] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:03.157433 2138 ts_tablet_manager.cc:933] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
W20260807 07:58:03.164928 30430 consensus_peers.cc:597] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa37679a25174c858a325e86cb2d5c94. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:58:03.170531 30578 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:58:03.172927 2079 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:03.182411 30367 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:58:03.190225 2079 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:03.207384 2092 raft_consensus.cc:2955] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:03.227208 30578 raft_consensus.cc:2955] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:03.295862 30489 consensus_queue.cc:237] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:03.296715 2138 tablet_copy_client.cc:323] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:58:03.298357 30386 tablet_copy_service.cc:140] P b1188d7d3a0b455894bc443d571f6a19: Received BeginTabletCopySession request for tablet 0eeea67c5e49472292549e65f2c9e844 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:33338)
I20260807 07:58:03.298970 30386 tablet_copy_service.cc:161] P b1188d7d3a0b455894bc443d571f6a19: Beginning new tablet copy session on tablet 0eeea67c5e49472292549e65f2c9e844 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:33338: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-0eeea67c5e49472292549e65f2c9e844
I20260807 07:58:03.307358 30386 tablet_copy_source_session.cc:215] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:58:03.316875 2138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eeea67c5e49472292549e65f2c9e844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:58:03.306872 30223 catalog_manager.cc:5697] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:03.310801 30367 raft_consensus.cc:2955] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:03.345639 30579 raft_consensus.cc:1275] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:58:03.355198 30367 raft_consensus.cc:1275] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260807 07:58:03.357787 30430 consensus_peers.cc:597] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1c3e02cee5d54a65bd61ae2521a9944c. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:58:03.358989 2092 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:03.380962 2092 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:03.383983 2098 raft_consensus.cc:2955] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:03.393656 30578 raft_consensus.cc:2955] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:03.407084 2138 tablet_copy_client.cc:806] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:58:03.407740 2138 tablet_copy_client.cc:670] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:58:03.413223 30221 catalog_manager.cc:5697] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:03.420843 30360 raft_consensus.cc:2955] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:03.420670 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:03.418282 2138 tablet_copy_client.cc:538] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:58:03.514596 2138 tablet_bootstrap.cc:492] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:58:03.514544 2147 ts_tablet_manager.cc:933] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:03.535862 30489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:03.537889 30489 raft_consensus.cc:606] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:03.555107 30579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:03.555737 30579 raft_consensus.cc:606] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 6 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:03.558502 30360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:03.559069 30360 raft_consensus.cc:606] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:03.559907 2147 tablet_copy_client.cc:323] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
I20260807 07:58:03.561992 30360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:03.568827 30502 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet 24224c3e18ec49578bb6c7bd4fd217b5 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
I20260807 07:58:03.569401 30502 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet 24224c3e18ec49578bb6c7bd4fd217b5 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-24224c3e18ec49578bb6c7bd4fd217b5
I20260807 07:58:03.567683 30360 raft_consensus.cc:606] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:03.578756 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 07:58:03.580822 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:03.581700 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:03.577986 30502 tablet_copy_source_session.cc:215] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:58:03.599153 2147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24224c3e18ec49578bb6c7bd4fd217b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:58:03.673925 2147 tablet_copy_client.cc:806] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:58:03.674696 2147 tablet_copy_client.cc:670] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:58:03.689868 2101 raft_consensus.cc:993] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:03.690428 2101 raft_consensus.cc:1081] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 6 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:03.690483 2111 raft_consensus.cc:993] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:03.691326 2049 raft_consensus.cc:1081] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:03.694438 30487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:58:03.694965 30487 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:03.695298 30487 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:03.695674 30367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45054
I20260807 07:58:03.696264 30367 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:03.696615 30367 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:03.731330 30367 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:03.745618 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:03.746268 30578 raft_consensus.cc:3055] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:03.746554 30578 raft_consensus.cc:740] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:03.747273 30578 consensus_queue.cc:260] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:03.748350 30578 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:03.747737 30367 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:03.766701 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:03.767537 30489 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:03.737460 30487 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:03.742686 2147 tablet_copy_client.cc:538] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:58:03.805277 30578 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:03.813850 30487 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:03.871567 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:03.872175 30585 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:03.876048 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:03.876681 30358 raft_consensus.cc:3055] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:58:03.876962 30358 raft_consensus.cc:740] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:03.884322 2147 tablet_bootstrap.cc:492] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:58:03.888623 2087 raft_consensus.cc:993] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:03.891855 30489 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:03.892190 2087 raft_consensus.cc:1081] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:03.892246 2156 ts_tablet_manager.cc:933] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:03.895035 30358 consensus_queue.cc:260] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:03.893421 30585 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 9.
I20260807 07:58:03.896230 30358 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:03.899528 30317 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:03.902163 2158 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:03.903651 2158 raft_consensus.cc:697] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:03.904570 30579 raft_consensus.cc:1240] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 8. Current term is 9. Ops: []
I20260807 07:58:03.904688 2158 consensus_queue.cc:237] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:03.919114 30358 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 9.
I20260807 07:58:03.925856 30489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:58:03.926434 30489 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:03.926797 30489 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:03.949883 2138 tablet_bootstrap.cc:492] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:58:03.924382 2156 tablet_copy_client.cc:323] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
I20260807 07:58:04.010632 2138 tablet_bootstrap.cc:492] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:58:04.011600 2138 ts_tablet_manager.cc:1403] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.497s user 0.051s sys 0.054s
W20260807 07:58:03.944181 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 46565.3us
I20260807 07:58:04.021526 30502 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet aa37679a25174c858a325e86cb2d5c94 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
I20260807 07:58:04.022181 30502 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet aa37679a25174c858a325e86cb2d5c94 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-aa37679a25174c858a325e86cb2d5c94
I20260807 07:58:04.031060 30429 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:04.029580 30489 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:04.032912 30489 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:04.053308 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:04.054070 30358 raft_consensus.cc:3055] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:04.054490 2098 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 07:58:04.061679 30358 raft_consensus.cc:740] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:04.062752 30358 consensus_queue.cc:260] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:04.064349 30358 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:04.045473 2138 raft_consensus.cc:359] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:04.075040 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:04.071930 30223 catalog_manager.cc:5697] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 6 to 7, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:04.076383 30358 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:04.075606 30578 raft_consensus.cc:3060] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:04.083563 30578 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:04.073197 2138 raft_consensus.cc:740] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:58:04.078888 2098 raft_consensus.cc:697] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:04.140698 30502 tablet_copy_source_session.cc:215] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:58:04.177556 2098 consensus_queue.cc:237] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:04.208611 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 49157.8us
I20260807 07:58:04.209347 30429 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:58:04.222048 2162 log.cc:927] Time spent T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.149s user 0.000s sys 0.001s
W20260807 07:58:04.243903 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 77537.5us
I20260807 07:58:04.181879 2138 consensus_queue.cc:260] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:04.284188 2138 ts_tablet_manager.cc:1434] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.272s user 0.008s sys 0.000s
I20260807 07:58:04.298018 2184 ts_tablet_manager.cc:933] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:04.285627 2177 raft_consensus.cc:2804] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:04.316767 31382 raft_consensus.cc:1217] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Deduplicated request from leader. Original: 6.5->[6.6-6.6] Dedup: 6.6->[]
I20260807 07:58:04.327908 2177 raft_consensus.cc:697] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:04.328891 2177 consensus_queue.cc:237] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:04.343243 2156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa37679a25174c858a325e86cb2d5c94. 1 dirs total, 0 dirs full, 0 dirs failed
W20260807 07:58:04.376583 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 84509.8us
I20260807 07:58:04.376121 30386 tablet_copy_service.cc:342] P b1188d7d3a0b455894bc443d571f6a19: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-0eeea67c5e49472292549e65f2c9e844 received from {username='slave'} at 127.0.0.1:33338
I20260807 07:58:04.385643 30386 tablet_copy_service.cc:434] P b1188d7d3a0b455894bc443d571f6a19: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-0eeea67c5e49472292549e65f2c9e844 on tablet 0eeea67c5e49472292549e65f2c9e844 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:04.402137 2147 tablet_bootstrap.cc:492] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:58:04.403141 2147 tablet_bootstrap.cc:492] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:58:04.403843 2147 ts_tablet_manager.cc:1403] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.520s user 0.048s sys 0.025s
I20260807 07:58:04.386204 2184 tablet_copy_client.cc:323] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
I20260807 07:58:04.395731 2192 raft_consensus.cc:993] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:04.417804 30502 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet 1c3e02cee5d54a65bd61ae2521a9944c from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
I20260807 07:58:04.423672 30502 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet 1c3e02cee5d54a65bd61ae2521a9944c from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-1c3e02cee5d54a65bd61ae2521a9944c
I20260807 07:58:04.438519 2192 raft_consensus.cc:1081] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:04.439291 30489 raft_consensus.cc:1275] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:58:04.440907 2175 consensus_queue.cc:1048] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:04.420692 30221 catalog_manager.cc:5697] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 8 to 9, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 9 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:04.449059 30221 catalog_manager.cc:5697] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 7 to 8, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 8 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:04.465071 30358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:04.465683 30358 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:04.466042 30358 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:04.474903 30502 tablet_copy_source_session.cc:215] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:58:04.480257 30358 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:04.446691 2147 raft_consensus.cc:359] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:04.485000 2184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c3e02cee5d54a65bd61ae2521a9944c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:58:04.498888 30358 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:04.499058 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:04.499617 30579 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:04.496551 2147 raft_consensus.cc:740] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:58:04.501504 2147 consensus_queue.cc:260] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:04.504056 2147 ts_tablet_manager.cc:1434] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.100s user 0.009s sys 0.000s
I20260807 07:58:04.505085 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:04.505674 30482 raft_consensus.cc:3055] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:04.505939 30482 raft_consensus.cc:740] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:04.506632 30482 consensus_queue.cc:260] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:04.507444 30482 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:04.508462 30579 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:04.509749 30320 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:04.510800 2175 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:04.515837 30482 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:04.520125 2175 raft_consensus.cc:697] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:04.521070 2175 consensus_queue.cc:237] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:04.522028 30579 raft_consensus.cc:1275] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:58:04.525847 2158 consensus_queue.cc:1048] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:04.549337 30502 tablet_copy_service.cc:342] P ef1ca7acf52a438f89f14707e9e06818: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-24224c3e18ec49578bb6c7bd4fd217b5 received from {username='slave'} at 127.0.0.1:34358
I20260807 07:58:04.552475 30502 tablet_copy_service.cc:434] P ef1ca7acf52a438f89f14707e9e06818: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-24224c3e18ec49578bb6c7bd4fd217b5 on tablet 24224c3e18ec49578bb6c7bd4fd217b5 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:04.558703 2156 tablet_copy_client.cc:806] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:58:04.559345 2156 tablet_copy_client.cc:670] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:58:04.564043 2156 tablet_copy_client.cc:538] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:58:04.582779 30222 catalog_manager.cc:5697] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 7 to 8, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 8 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:04.599140 30358 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260807 07:58:04.613188 2153 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:58:04.613951 2184 tablet_copy_client.cc:806] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:58:04.616293 2184 tablet_copy_client.cc:670] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:58:04.637027 2184 tablet_copy_client.cc:538] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:58:04.646852 2156 tablet_bootstrap.cc:492] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:58:04.661857 2184 tablet_bootstrap.cc:492] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:58:04.680099 30581 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260807 07:58:04.687834 2158 raft_consensus.cc:1064] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:58:04.692684 2177 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:04.705428 2158 consensus_queue.cc:237] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:04.779742 31383 raft_consensus.cc:1217] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5] Dedup: 6.5->[]
I20260807 07:58:04.799858 30478 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:04.802661 31382 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:04.808848 2188 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:04.809446 30578 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:04.808849 30579 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:58:04.812912 2049 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:04.813588 2153 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:04.819453 2158 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:04.849048 30358 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:58:04.849807 2156 tablet_bootstrap.cc:492] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:58:04.850862 2156 tablet_bootstrap.cc:492] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:58:04.851534 2177 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:04.851643 2156 ts_tablet_manager.cc:1403] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.205s user 0.022s sys 0.026s
I20260807 07:58:04.877419 2156 raft_consensus.cc:359] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:04.878266 2156 raft_consensus.cc:740] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:58:04.878978 2156 consensus_queue.cc:260] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:04.888275 2156 ts_tablet_manager.cc:1434] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.033s user 0.014s sys 0.000s
I20260807 07:58:04.891426 30502 tablet_copy_service.cc:342] P ef1ca7acf52a438f89f14707e9e06818: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-aa37679a25174c858a325e86cb2d5c94 received from {username='slave'} at 127.0.0.1:34358
I20260807 07:58:04.891880 30502 tablet_copy_service.cc:434] P ef1ca7acf52a438f89f14707e9e06818: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-aa37679a25174c858a325e86cb2d5c94 on tablet aa37679a25174c858a325e86cb2d5c94 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:04.928328 2184 tablet_bootstrap.cc:492] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:58:04.937963 2158 raft_consensus.cc:2955] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:04.940879 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:04.943172 31382 raft_consensus.cc:2955] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:04.977818 30222 catalog_manager.cc:5697] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:04.983590 30478 raft_consensus.cc:2955] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:04.991201 30578 raft_consensus.cc:2955] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:04.929288 2184 tablet_bootstrap.cc:492] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:58:05.014681 2184 ts_tablet_manager.cc:1403] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.353s user 0.021s sys 0.012s
I20260807 07:58:05.018376 2184 raft_consensus.cc:359] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:05.019212 2184 raft_consensus.cc:740] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:58:05.019848 2184 consensus_queue.cc:260] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:05.023414 2184 ts_tablet_manager.cc:1434] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260807 07:58:05.025862 30502 tablet_copy_service.cc:342] P ef1ca7acf52a438f89f14707e9e06818: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-1c3e02cee5d54a65bd61ae2521a9944c received from {username='slave'} at 127.0.0.1:34358
I20260807 07:58:05.026294 30502 tablet_copy_service.cc:434] P ef1ca7acf52a438f89f14707e9e06818: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-1c3e02cee5d54a65bd61ae2521a9944c on tablet 1c3e02cee5d54a65bd61ae2521a9944c with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:05.033999 31382 raft_consensus.cc:1217] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4] Dedup: 5.4->[]
I20260807 07:58:05.038954 30579 raft_consensus.cc:1275] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 07:58:05.040614 2181 consensus_queue.cc:1048] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:05.060317 31382 raft_consensus.cc:1217] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4] Dedup: 4.4->[]
I20260807 07:58:05.079177 30360 consensus_queue.cc:237] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:05.094421 31382 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 07:58:05.097318 2049 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:05.109979 30579 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 07:58:05.128120 2158 raft_consensus.cc:2955] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:05.141964 31382 raft_consensus.cc:2955] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:05.147169 2158 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:05.147800 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0eeea67c5e49472292549e65f2c9e844 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:58:05.151923 30487 raft_consensus.cc:1275] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 07:58:05.155114 2158 consensus_queue.cc:1048] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:05.154764 30578 raft_consensus.cc:2955] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:05.186002 30223 catalog_manager.cc:5697] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index 7 to 8, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:05.131310 30360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:05.198225 30459 tablet_service.cc:1558] Processing DeleteTablet for tablet 0eeea67c5e49472292549e65f2c9e844 with delete_type TABLET_DATA_TOMBSTONED (TS ef1ca7acf52a438f89f14707e9e06818 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:33906
I20260807 07:58:05.198410 30360 raft_consensus.cc:606] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:05.201213 30478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:05.201805 30478 raft_consensus.cc:606] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:05.209590 30478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:05.210124 30478 raft_consensus.cc:606] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:05.216145 30579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:05.216708 30579 raft_consensus.cc:606] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:05.219750 30367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:05.220292 30367 raft_consensus.cc:606] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 10 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:05.221578 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260807 07:58:05.223377 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:05.224123 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:05.235329 2158 raft_consensus.cc:993] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:05.235889 2158 raft_consensus.cc:1081] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:05.237785 30478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:58:05.238381 30478 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:05.238726 30478 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:05.245596 2075 raft_consensus.cc:993] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:05.246075 2075 raft_consensus.cc:1081] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:05.247926 30482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:58:05.248445 30482 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:05.248785 30482 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:05.257632 2236 tablet_replica.cc:333] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818: stopping tablet replica
I20260807 07:58:05.261122 30482 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:05.301151 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:05.301824 30367 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:05.302198 2236 raft_consensus.cc:2243] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:05.302595 30478 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:05.303069 2236 raft_consensus.cc:2272] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:05.306147 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:05.306689 30358 raft_consensus.cc:3055] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:05.306977 30358 raft_consensus.cc:740] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:05.307600 2236 ts_tablet_manager.cc:1916] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:05.307679 30358 consensus_queue.cc:260] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:05.310278 30367 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:05.312008 30429 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:05.318385 30482 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:05.320650 2177 raft_consensus.cc:2804] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:05.321188 2177 raft_consensus.cc:697] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:05.322831 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:05.323449 30578 raft_consensus.cc:3055] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:05.323799 30578 raft_consensus.cc:740] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:05.323345 2177 consensus_queue.cc:237] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:05.324479 30578 consensus_queue.cc:260] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:05.325309 2236 ts_tablet_manager.cc:1929] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.7
I20260807 07:58:05.325811 2236 log.cc:1199] T 0eeea67c5e49472292549e65f2c9e844 P ef1ca7acf52a438f89f14707e9e06818: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root/wals/0eeea67c5e49472292549e65f2c9e844
I20260807 07:58:05.327380 30358 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:05.325724 30578 raft_consensus.cc:3060] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:05.332330 30201 catalog_manager.cc:5028] TS ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): tablet 0eeea67c5e49472292549e65f2c9e844 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:05.350828 30478 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:05.359385 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:05.359985 30579 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:05.367774 30579 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:05.370656 2182 raft_consensus.cc:993] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:05.371240 2183 raft_consensus.cc:1081] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:05.373688 30360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:05.374264 30360 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:05.374655 30360 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:05.352998 30358 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:05.386957 30578 raft_consensus.cc:2468] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:05.387588 30429 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:05.388887 2187 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:05.389359 2187 raft_consensus.cc:697] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:05.390197 2187 consensus_queue.cc:237] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:05.393752 2087 raft_consensus.cc:993] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:05.394198 2087 raft_consensus.cc:1081] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 10 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:05.401031 30578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:58:05.401564 30578 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:05.402050 30578 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:05.403091 30360 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:05.408346 2182 raft_consensus.cc:1064] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
W20260807 07:58:05.408746 2182 raft_consensus.cc:1068] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818: Unable to promote non-voter 6bd20e9c0d3e4ace86fc1f55ab9425fa: Service unavailable: leader transfer in progress
I20260807 07:58:05.409462 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:05.410022 30581 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:05.410827 30223 catalog_manager.cc:5697] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 7 to 8, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 8 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:05.417265 30581 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:05.420233 30320 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:05.421067 2158 raft_consensus.cc:2804] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:05.421573 2158 raft_consensus.cc:697] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:05.422566 2158 consensus_queue.cc:237] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:05.429359 30578 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:05.431309 30578 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:05.432685 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:05.433305 30478 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:05.433445 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:05.434122 30367 raft_consensus.cc:3055] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 10 LEADER]: Stepping down as leader of term 10
I20260807 07:58:05.434409 30367 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:05.435339 30367 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:05.436378 30367 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:05.438248 30360 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:05.440310 30478 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 11.
I20260807 07:58:05.441697 30539 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:05.442577 2237 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader election won for term 11
I20260807 07:58:05.443809 2237 raft_consensus.cc:697] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 11 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:05.444823 2237 consensus_queue.cc:237] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:05.452517 30367 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 11.
I20260807 07:58:05.458355 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:05.459008 30478 raft_consensus.cc:3055] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:05.459313 30478 raft_consensus.cc:740] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:05.460084 30478 consensus_queue.cc:260] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:05.464751 30478 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:05.482213 30221 catalog_manager.cc:5697] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 10 to 11, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 11 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:58:05.472723 30223 catalog_manager.cc:5697] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 6 to 7, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:05.492055 30478 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:05.498281 2177 raft_consensus.cc:1064] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:58:05.503214 30220 catalog_manager.cc:5697] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 6 to 7, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:05.500960 2177 consensus_queue.cc:237] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:05.513556 2183 raft_consensus.cc:1064] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:58:05.560999 2183 consensus_queue.cc:237] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:05.623524 31385 raft_consensus.cc:1275] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:58:05.624188 30578 raft_consensus.cc:1275] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:58:05.623529 31382 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEARNER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:58:05.624953 30360 raft_consensus.cc:1275] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:58:05.627506 2187 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:05.628562 2177 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:05.633052 30360 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:58:05.633682 30581 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260807 07:58:05.634065 2243 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:05.635452 2153 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:05.636089 2243 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:05.652887 2177 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260807 07:58:05.724997 2183 raft_consensus.cc:993] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:05.725548 2187 raft_consensus.cc:1081] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:05.730893 30581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34594
I20260807 07:58:05.731473 30581 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:05.731822 30581 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:05.748829 30581 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:05.751524 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:05.751729 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:05.752137 30487 raft_consensus.cc:3055] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:05.752283 31382 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:05.752514 30487 raft_consensus.cc:740] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:05.753273 30487 consensus_queue.cc:260] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:05.754614 30487 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:05.759193 31382 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:58:05.760521 30542 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:05.761345 2238 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:05.761950 2238 raft_consensus.cc:697] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:05.762840 2238 consensus_queue.cc:237] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:05.784123 30581 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:05.794929 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 122808us
I20260807 07:58:05.807801 30487 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
W20260807 07:58:05.876612 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 46365.8us
I20260807 07:58:05.914008 30487 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260807 07:58:05.925807 2238 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 07:58:05.996886 30581 raft_consensus.cc:1275] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:58:05.999207 30366 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:06.017493 2183 consensus_queue.cc:1048] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:06.028291 30581 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:06.030068 30366 raft_consensus.cc:1275] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260807 07:58:06.005230 2269 log.cc:927] Time spent T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.102s user 0.000s sys 0.000s
I20260807 07:58:06.066623 2187 consensus_queue.cc:1048] T 8c079d52d21e409b82acfebf494a8700 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:06.132822 31385 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Advancing to term 7
I20260807 07:58:06.141798 31385 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:06.071311 2183 raft_consensus.cc:2955] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:06.088527 2243 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260807 07:58:06.179931 2158 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260807 07:58:06.208209 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 216056us
I20260807 07:58:06.307279 30367 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260807 07:58:06.347170 2270 log.cc:927] Time spent T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.436s user 0.005s sys 0.000s
I20260807 07:58:06.385351 30478 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260807 07:58:06.392303 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 99978us
W20260807 07:58:06.472316 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 414232us
I20260807 07:58:06.493139 30480 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 07:58:06.505299 30221 catalog_manager.cc:5697] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 5 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:06.514277 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:06.529157 31380 raft_consensus.cc:2955] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:06.549408 2158 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:06.554162 31382 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260807 07:58:06.572307 2262 log.cc:927] Time spent T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.660s user 0.008s sys 0.003s
W20260807 07:58:06.574788 2268 log.cc:927] Time spent T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.666s user 0.002s sys 0.004s
W20260807 07:58:06.588546 2292 log.cc:927] Time spent T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.179s user 0.001s sys 0.001s
I20260807 07:58:06.604828 2281 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 07:58:06.636997 2191 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260807 07:58:06.663539 2191 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260807 07:58:06.671684 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 95402.8us
I20260807 07:58:06.689049 2252 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:06.690099 2187 raft_consensus.cc:2955] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:58:06.696098 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 84669.2us
I20260807 07:58:06.739565 2263 raft_consensus.cc:1064] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
W20260807 07:58:06.740130 2263 raft_consensus.cc:1068] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19: Unable to promote non-voter 6bd20e9c0d3e4ace86fc1f55ab9425fa: Illegal state: Leader has not yet committed an operation in its own term
I20260807 07:58:06.785452 30578 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:06.775655 30220 catalog_manager.cc:5697] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:06.805851 2264 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:06.821200 30578 raft_consensus.cc:2955] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:06.849308 30366 raft_consensus.cc:2955] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:06.910565 30364 raft_consensus.cc:2955] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:06.919085 31382 raft_consensus.cc:2955] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:58:06.946172 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 68457.4us
I20260807 07:58:07.038189 30579 raft_consensus.cc:2955] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:58:07.087509 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 44927.4us
W20260807 07:58:07.239686 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 69881.3us
I20260807 07:58:07.240374 2263 raft_consensus.cc:1064] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:58:07.254873 30221 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53660 (request call id 311) took 1342 ms. Trace:
I20260807 07:58:07.255462 30221 rpcz_store.cc:276] 0807 07:58:05.912868 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:05.917240 (+ 4372us) service_pool.cc:224] Handling call
0807 07:58:07.254793 (+1337553us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:58:06.788792 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:58:06.789556 (+ 764us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:58:06.789613 (+ 57us) write_op.cc:435] Acquired schema lock
0807 07:58:06.789649 (+ 36us) tablet.cc:662] Decoding operations
0807 07:58:06.790123 (+ 474us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:58:06.790243 (+ 120us) write_op.cc:641] Partition lock acquired for write op
0807 07:58:06.790279 (+ 36us) tablet.cc:685] Acquiring locks for 1 operations
0807 07:58:06.790701 (+ 422us) tablet.cc:701] Row locks acquired
0807 07:58:06.790747 (+ 46us) write_op.cc:260] PREPARE: finished
0807 07:58:06.790927 (+ 180us) write_op.cc:270] Start()
0807 07:58:06.791068 (+ 141us) write_op.cc:276] Timestamp: P: 1786089486790862 usec, L: 0
0807 07:58:06.791110 (+ 42us) op_driver.cc:348] REPLICATION: starting
0807 07:58:06.791938 (+ 828us) log.cc:844] Serialized 536 byte log entry
0807 07:58:07.040150 (+248212us) op_driver.cc:464] REPLICATION: finished
0807 07:58:07.194894 (+154744us) write_op.cc:301] APPLY: starting
0807 07:58:07.195073 (+ 179us) tablet.cc:1367] starting BulkCheckPresence
0807 07:58:07.195236 (+ 163us) tablet.cc:1370] finished BulkCheckPresence
0807 07:58:07.195371 (+ 135us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:58:07.195701 (+ 330us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:58:07.251063 (+ 55362us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 07:58:07.251141 (+ 78us) write_op.cc:312] APPLY: finished
0807 07:58:07.251436 (+ 295us) log.cc:844] Serialized 23 byte log entry
0807 07:58:07.251632 (+ 196us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:07.251717 (+ 85us) write_op.cc:454] Released schema lock
0807 07:58:07.251768 (+ 51us) write_op.cc:341] FINISH: Updating metrics
0807 07:58:07.252283 (+ 515us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:07.252311 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30529,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":132678,"apply.run_cpu_time_us":2496,"apply.run_wall_time_us":70240,"num_ops":1,"prepare.queue_time_us":145283,"prepare.run_cpu_time_us":32284,"prepare.run_wall_time_us":80938,"raft.queue_time_us":257854,"raft.run_cpu_time_us":33763,"raft.run_wall_time_us":145196,"replication_time_us":248839,"thread_start_us":357592,"threads_started":4,"wal-append.queue_time_us":107095}]]}
I20260807 07:58:07.243217 2263 consensus_queue.cc:237] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:07.292546 30480 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 07:58:07.297084 2163 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:07.300519 31384 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 07:58:07.305662 2328 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:58:07.311863 30588 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 07:58:07.328619 2087 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:07.329010 30222 catalog_manager.cc:5697] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index 4 to 5, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:07.364583 2163 raft_consensus.cc:2955] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.370786 30487 raft_consensus.cc:2955] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.385850 30579 raft_consensus.cc:2955] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.452714 31383 raft_consensus.cc:2955] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.479564 30487 consensus_queue.cc:237] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:07.484937 30490 consensus_queue.cc:237] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:07.476246 30220 catalog_manager.cc:5697] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index 5 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:07.494493 30581 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 07:58:07.496515 31384 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260807 07:58:07.505657 30581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:07.506392 30581 raft_consensus.cc:606] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:07.497977 2177 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260807 07:58:07.507797 2243 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:07.537590 30360 consensus_queue.cc:237] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:07.544692 2291 raft_consensus.cc:2955] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.549357 31384 raft_consensus.cc:1275] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:58:07.550998 2183 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:07.551863 30367 raft_consensus.cc:1275] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260807 07:58:07.558665 2187 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:07.553746 30579 raft_consensus.cc:2955] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.568713 2243 raft_consensus.cc:2955] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.577540 30487 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:07.579128 2163 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:07.587164 31383 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:07.587002 2264 raft_consensus.cc:2955] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.587719 31384 raft_consensus.cc:2955] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.590086 31382 raft_consensus.cc:2955] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.593165 2328 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:07.603118 31383 raft_consensus.cc:2955] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.603353 30222 catalog_manager.cc:5697] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index 5 to 6, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.607426 30487 raft_consensus.cc:2955] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.585652 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:07.612900 30480 raft_consensus.cc:606] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:07.612653 30363 raft_consensus.cc:2955] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.624845 30360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:07.628672 30345 tablet_service.cc:1558] Processing DeleteTablet for tablet aa37679a25174c858a325e86cb2d5c94 with delete_type TABLET_DATA_TOMBSTONED (TS b1188d7d3a0b455894bc443d571f6a19 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45034
I20260807 07:58:07.638936 30223 catalog_manager.cc:5697] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 7 to 8, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.646871 2365 tablet_replica.cc:333] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19: stopping tablet replica
I20260807 07:58:07.649427 2365 raft_consensus.cc:2243] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:07.647663 30360 raft_consensus.cc:606] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:07.651528 2365 raft_consensus.cc:2272] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:07.654708 30221 catalog_manager.cc:5697] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index 5 to 6, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:07.656766 30490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:07.657361 30490 raft_consensus.cc:606] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:07.659349 30201 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1c3e02cee5d54a65bd61ae2521a9944c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:58:07.660239 30201 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa37679a25174c858a325e86cb2d5c94 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:58:07.664780 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 07:58:07.666560 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:07.667687 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:07.670410 30564 tablet_service.cc:1558] Processing DeleteTablet for tablet 24224c3e18ec49578bb6c7bd4fd217b5 with delete_type TABLET_DATA_TOMBSTONED (TS f831a53ec51d452398015797d543164e not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:34588
I20260807 07:58:07.671437 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 24224c3e18ec49578bb6c7bd4fd217b5 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:58:07.688429 30569 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c3e02cee5d54a65bd61ae2521a9944c with delete_type TABLET_DATA_TOMBSTONED (TS f831a53ec51d452398015797d543164e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34588
I20260807 07:58:07.698048 2365 ts_tablet_manager.cc:1916] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:07.705506 2366 tablet_replica.cc:333] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e: stopping tablet replica
I20260807 07:58:07.712880 2366 raft_consensus.cc:2243] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:07.713860 2366 raft_consensus.cc:2272] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:07.733544 2366 ts_tablet_manager.cc:1916] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:07.734211 2243 raft_consensus.cc:993] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:07.734722 2243 raft_consensus.cc:1081] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:07.739954 30367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:07.740669 30367 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:07.742271 30367 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:07.751063 30367 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:07.757257 2361 raft_consensus.cc:993] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:07.757905 2361 raft_consensus.cc:1081] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:07.759585 30490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:58:07.759744 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:07.759805 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:07.760143 30490 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:07.760680 30490 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:07.761065 30487 raft_consensus.cc:3055] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:07.760360 30367 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:07.760670 30579 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:07.764500 2365 ts_tablet_manager.cc:1929] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260807 07:58:07.765025 2365 log.cc:1199] T aa37679a25174c858a325e86cb2d5c94 P b1188d7d3a0b455894bc443d571f6a19: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root/wals/aa37679a25174c858a325e86cb2d5c94
I20260807 07:58:07.766929 30203 catalog_manager.cc:5028] TS b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): tablet aa37679a25174c858a325e86cb2d5c94 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:07.769594 30490 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:07.771405 30490 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:07.780421 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:07.761453 30487 raft_consensus.cc:740] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:07.781827 30487 consensus_queue.cc:260] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:07.782423 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:07.780967 30588 raft_consensus.cc:3055] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:07.783107 30487 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:07.783322 30588 raft_consensus.cc:740] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:07.784181 30588 consensus_queue.cc:260] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:07.786299 30588 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:07.789554 30579 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:07.792096 30320 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:07.792867 2163 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:07.793365 2163 raft_consensus.cc:697] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:07.794195 2163 consensus_queue.cc:237] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:07.799782 30367 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:07.816664 30367 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:07.829170 30487 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:07.839205 30588 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:07.841370 30429 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:07.849148 2183 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:07.849653 2183 raft_consensus.cc:697] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:07.850466 2183 consensus_queue.cc:237] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:07.864434 2366 ts_tablet_manager.cc:1929] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260807 07:58:07.866629 2366 log.cc:1199] T 24224c3e18ec49578bb6c7bd4fd217b5 P f831a53ec51d452398015797d543164e: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root/wals/24224c3e18ec49578bb6c7bd4fd217b5
I20260807 07:58:07.868732 2366 tablet_replica.cc:333] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e: stopping tablet replica
I20260807 07:58:07.869429 30203 catalog_manager.cc:5028] TS f831a53ec51d452398015797d543164e (127.27.64.131:33207): tablet 24224c3e18ec49578bb6c7bd4fd217b5 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:07.870488 30220 catalog_manager.cc:5697] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 6 to 7, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:07.867391 30221 catalog_manager.cc:5697] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 5 to 6, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:07.900913 2366 raft_consensus.cc:2243] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:07.901924 2366 raft_consensus.cc:2272] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:07.923106 2366 ts_tablet_manager.cc:1916] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:07.931339 2183 raft_consensus.cc:993] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:07.931905 2183 raft_consensus.cc:1081] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:07.934115 30360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:07.934682 30360 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:07.935024 30360 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:07.946173 30360 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:07.970413 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:07.970992 30487 raft_consensus.cc:3055] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:07.971278 30487 raft_consensus.cc:740] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:07.972051 30487 consensus_queue.cc:260] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:07.973100 30487 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:07.982858 30487 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:07.991199 30317 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:07.992714 2087 raft_consensus.cc:2804] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:07.984712 30360 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:07.987727 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:07.997092 31384 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:07.998555 2087 raft_consensus.cc:697] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:08.003187 2087 consensus_queue.cc:237] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:08.009353 31384 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:08.031951 2264 raft_consensus.cc:993] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:08.032423 2264 raft_consensus.cc:1081] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:08.034482 2366 ts_tablet_manager.cc:1929] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260807 07:58:08.035020 2366 log.cc:1199] T 1c3e02cee5d54a65bd61ae2521a9944c P f831a53ec51d452398015797d543164e: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root/wals/1c3e02cee5d54a65bd61ae2521a9944c
I20260807 07:58:08.035825 30579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:58:08.036410 30579 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:08.036782 30579 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:08.034505 30221 catalog_manager.cc:5697] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 6 to 7, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:08.036712 30203 catalog_manager.cc:5028] TS f831a53ec51d452398015797d543164e (127.27.64.131:33207): tablet 1c3e02cee5d54a65bd61ae2521a9944c (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:08.043622 30579 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:08.046453 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:08.046999 30360 raft_consensus.cc:3055] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:08.047293 30360 raft_consensus.cc:740] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:08.048036 30360 consensus_queue.cc:260] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:08.049074 30360 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:08.062456 30360 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:58:08.063519 30541 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:08.064304 2276 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:08.064760 2276 raft_consensus.cc:697] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 8 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:08.065627 2276 consensus_queue.cc:237] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:08.076682 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:08.077255 30487 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:08.084484 30487 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:58:08.085886 30579 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:08.123287 30221 catalog_manager.cc:5697] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e reported cstate change: term changed from 7 to 8, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 8 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:58:08.207370 30579 raft_consensus.cc:1275] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:08.208932 2087 consensus_queue.cc:1048] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:08.240422 30487 raft_consensus.cc:1275] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:08.245335 2327 consensus_queue.cc:1048] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:08.272059 30579 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:58:08.277364 2183 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:08.305508 30360 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:58:08.307085 2183 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:08.416042 30487 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:08.418154 2087 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 07:58:08.454104 30360 raft_consensus.cc:1275] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:58:08.455792 2290 consensus_queue.cc:1048] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:08.471601 31384 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:08.473100 2087 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:08.479509 30480 raft_consensus.cc:1275] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:58:08.481925 2276 consensus_queue.cc:1048] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:08.880234 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:09.016155 30487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:09.016741 30487 raft_consensus.cc:606] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:09.020077 30367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:09.020643 30367 raft_consensus.cc:606] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:09.029666 30588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:09.030269 30588 raft_consensus.cc:606] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 7 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:09.033675 30360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:09.034178 30360 raft_consensus.cc:606] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Received request to transfer leadership to TS 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:09.035418 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 07:58:09.037348 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:09.038405 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:09.080330 30487 consensus_queue.cc:237] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:58:09.089304 30430 consensus_peers.cc:597] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 151ecad19f9e4079986c980524b2f3c0. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:58:09.090090 30579 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:58:09.093521 2252 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:09.095669 30367 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:58:09.104406 2252 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:09.110610 2187 raft_consensus.cc:2955] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:09.115017 30588 raft_consensus.cc:2955] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:09.136411 30367 raft_consensus.cc:2955] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:09.144718 30220 catalog_manager.cc:5697] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:09.197013 30360 consensus_queue.cc:237] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:09.239480 2183 raft_consensus.cc:993] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:09.240016 2183 raft_consensus.cc:1081] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:09.289279 2264 raft_consensus.cc:993] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower 6bd20e9c0d3e4ace86fc1f55ab9425fa to start an election
I20260807 07:58:09.289827 2264 raft_consensus.cc:1081] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Signalling peer 6bd20e9c0d3e4ace86fc1f55ab9425fa to start an election
I20260807 07:58:09.308157 31382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278"
dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
from {username='slave'} at 127.0.0.1:59320
I20260807 07:58:09.308769 31382 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:09.309131 31382 raft_consensus.cc:3060] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:58:09.327477 2290 raft_consensus.cc:993] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:09.328044 2276 raft_consensus.cc:1081] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 7 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:09.353663 30487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:58:09.354230 30487 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:09.355157 30487 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
W20260807 07:58:09.368749 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 137138us
I20260807 07:58:09.371044 31382 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:09.373310 30363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:09.373936 30363 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:09.374337 30363 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:09.373139 31382 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:09.388238 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:09.388840 30367 raft_consensus.cc:3055] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:58:09.389140 30367 raft_consensus.cc:740] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:09.389856 30367 consensus_queue.cc:260] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:09.391116 30367 raft_consensus.cc:3060] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Advancing to term 3
W20260807 07:58:09.396351 30323 consensus_peers.cc:597] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0f6bb896213415485f2dee06ba250b8. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:58:09.399698 30367 raft_consensus.cc:2468] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 3.
I20260807 07:58:09.417101 31338 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
I20260807 07:58:09.418324 2303 raft_consensus.cc:2804] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:58:09.419437 2303 raft_consensus.cc:697] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:09.431324 2303 consensus_queue.cc:237] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:09.424798 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 57391.2us
I20260807 07:58:09.426065 30363 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:09.439770 30363 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:09.423662 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 61110.1us
I20260807 07:58:09.448064 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:09.448730 30588 raft_consensus.cc:3060] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:58:09.467381 30581 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 07:58:09.467954 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:09.468811 30582 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:09.469985 2264 raft_consensus.cc:993] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:09.470695 2264 raft_consensus.cc:1081] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:09.483024 30588 raft_consensus.cc:2468] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 3.
I20260807 07:58:09.487967 30487 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:09.493062 2405 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:58:09.496665 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:09.496847 30487 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:09.497334 30490 raft_consensus.cc:3055] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:09.497627 30490 raft_consensus.cc:740] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:09.499221 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:09.499260 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:09.499904 30363 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:09.500000 30588 raft_consensus.cc:3055] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:09.500392 30588 raft_consensus.cc:740] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:09.503137 30490 consensus_queue.cc:260] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:09.505089 30480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:58:09.505729 30480 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:09.506115 30480 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:09.507110 30582 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:09.508373 30320 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:09.507423 30588 consensus_queue.cc:260] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:09.508808 30490 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:09.515115 30588 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:09.538674 30363 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:09.540581 30588 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:09.541864 30429 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:09.556470 30590 raft_consensus.cc:1240] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:09.564121 30490 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:09.555693 2328 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:09.572180 2183 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election won for term 8
W20260807 07:58:09.580593 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 69980.4us
W20260807 07:58:09.586141 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 60269.8us
I20260807 07:58:09.580610 2328 raft_consensus.cc:697] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:09.600327 30480 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:09.609736 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:09.610358 30363 raft_consensus.cc:3055] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:58:09.610692 30363 raft_consensus.cc:740] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:09.611847 30363 consensus_queue.cc:260] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:09.618839 30363 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:09.618458 2328 consensus_queue.cc:237] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:09.608309 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 73958.7us
I20260807 07:58:09.634223 30363 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 9.
W20260807 07:58:09.653512 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 109952us
I20260807 07:58:09.662926 30487 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 07:58:09.671079 30429 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:09.677141 2252 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 07:58:09.677891 2252 raft_consensus.cc:697] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:09.680172 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:09.680820 30590 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:09.682019 2408 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:58:09.644447 2183 raft_consensus.cc:697] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:09.679217 2252 consensus_queue.cc:237] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:09.722543 2426 ts_tablet_manager.cc:933] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:09.730368 2183 consensus_queue.cc:237] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:09.761065 30590 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 9.
W20260807 07:58:09.751905 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 47691.3us
I20260807 07:58:09.770376 30584 raft_consensus.cc:1240] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 8. Current term is 9. Ops: []
I20260807 07:58:09.778754 2412 raft_consensus.cc:2955] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:09.792131 2426 tablet_copy_client.cc:323] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
I20260807 07:58:09.789871 30590 raft_consensus.cc:2955] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:09.796205 30502 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet 151ecad19f9e4079986c980524b2f3c0 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
I20260807 07:58:09.797262 30502 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet 151ecad19f9e4079986c980524b2f3c0 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-151ecad19f9e4079986c980524b2f3c0
I20260807 07:58:09.820297 30480 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:09.834436 30502 tablet_copy_source_session.cc:215] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:58:09.853729 2426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151ecad19f9e4079986c980524b2f3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:58:09.880704 30223 catalog_manager.cc:5697] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index -1 to 7, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 8 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
W20260807 07:58:09.902916 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 51833.1us
I20260807 07:58:09.892926 30220 catalog_manager.cc:5697] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 2 to 3, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 3 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:09.910380 30222 catalog_manager.cc:5697] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 7 to 8, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 8 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:09.923950 30222 catalog_manager.cc:5697] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 8 to 9, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 9 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:09.936203 2426 tablet_copy_client.cc:806] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:58:09.936944 2426 tablet_copy_client.cc:670] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:58:09.942009 30477 consensus_queue.cc:237] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:09.943915 2426 tablet_copy_client.cc:538] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:58:09.954460 30489 raft_consensus.cc:2955] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:09.960704 2426 tablet_bootstrap.cc:492] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:58:09.955008 30220 catalog_manager.cc:5697] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 7 to 8, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 8 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
W20260807 07:58:09.963397 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 150820us
I20260807 07:58:09.970743 30364 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 07:58:09.972335 2433 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260807 07:58:09.975708 30430 consensus_peers.cc:597] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d130f3994424c29b619c9f702310fc9. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:58:09.984251 30360 raft_consensus.cc:1275] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 07:58:09.999298 30584 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260807 07:58:10.000586 2443 consensus_queue.cc:1048] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:10.002923 2433 raft_consensus.cc:2955] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:10.009526 30360 raft_consensus.cc:2955] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:10.017035 2426 tablet_bootstrap.cc:492] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:58:10.018105 2426 tablet_bootstrap.cc:492] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:58:10.018887 2426 ts_tablet_manager.cc:1403] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.058s user 0.025s sys 0.012s
I20260807 07:58:10.026023 2434 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260807 07:58:10.027643 2426 raft_consensus.cc:359] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:10.028474 2426 raft_consensus.cc:740] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:58:10.029151 2426 consensus_queue.cc:260] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:10.041795 2426 ts_tablet_manager.cc:1434] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.022s user 0.007s sys 0.000s
I20260807 07:58:10.044360 31382 raft_consensus.cc:1217] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5] Dedup: 6.5->[]
I20260807 07:58:10.045126 30502 tablet_copy_service.cc:342] P ef1ca7acf52a438f89f14707e9e06818: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-151ecad19f9e4079986c980524b2f3c0 received from {username='slave'} at 127.0.0.1:34358
I20260807 07:58:10.045709 30502 tablet_copy_service.cc:434] P ef1ca7acf52a438f89f14707e9e06818: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-151ecad19f9e4079986c980524b2f3c0 on tablet 151ecad19f9e4079986c980524b2f3c0 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:10.052316 2426 ts_tablet_manager.cc:933] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:58:10.059258 30477 consensus_queue.cc:237] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:10.064670 30223 catalog_manager.cc:5697] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 2 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:10.105954 30578 raft_consensus.cc:1275] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 07:58:10.105458 30584 raft_consensus.cc:2955] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:10.109102 30360 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 07:58:10.110564 2433 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:10.113966 2394 consensus_queue.cc:1048] T bca8ce0c4383454c82aca8ba08488278 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:10.115842 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:10.116667 30581 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260807 07:58:10.116976 30430 consensus_peers.cc:597] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b78e546552f4ce38217f522549d6f36. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:58:10.170115 30477 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 07:58:10.172394 2422 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:10.172931 2421 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:10.170114 2426 tablet_copy_client.cc:323] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:58:10.175858 30386 tablet_copy_service.cc:140] P b1188d7d3a0b455894bc443d571f6a19: Received BeginTabletCopySession request for tablet d0f6bb896213415485f2dee06ba250b8 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:33338)
I20260807 07:58:10.176417 30386 tablet_copy_service.cc:161] P b1188d7d3a0b455894bc443d571f6a19: Beginning new tablet copy session on tablet d0f6bb896213415485f2dee06ba250b8 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:33338: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-d0f6bb896213415485f2dee06ba250b8
I20260807 07:58:10.188359 30582 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 07:58:10.188809 30584 raft_consensus.cc:1275] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260807 07:58:10.207962 2434 raft_consensus.cc:2955] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:10.224169 30367 raft_consensus.cc:2955] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:10.243430 2412 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:10.308073 30386 tablet_copy_source_session.cc:215] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:58:10.317994 2393 consensus_queue.cc:1048] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:10.318499 2426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0f6bb896213415485f2dee06ba250b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:58:10.328029 30590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:10.328671 30590 raft_consensus.cc:606] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 5 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:10.332350 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:10.332978 30477 raft_consensus.cc:606] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:10.340301 30360 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:10.341475 30360 raft_consensus.cc:606] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:10.344556 30477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:10.345172 30477 raft_consensus.cc:606] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:10.348524 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 07:58:10.350350 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:10.351089 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
W20260807 07:58:10.370137 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 52333.1us
I20260807 07:58:10.398591 30590 raft_consensus.cc:1275] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:58:10.406594 30363 raft_consensus.cc:1275] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260807 07:58:10.410145 30363 raft_consensus.cc:1275] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260807 07:58:10.414078 30222 catalog_manager.cc:5697] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:10.425776 30590 raft_consensus.cc:2955] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:10.443152 2434 consensus_queue.cc:1048] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:10.451488 2393 consensus_queue.cc:1048] T 8f836ea19b1942d09da90d65732435dc P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:10.452535 2453 ts_tablet_manager.cc:933] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:10.453433 2393 consensus_queue.cc:1048] T 42f1efe3594f411d9ed19ae2875c1bf0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:10.462613 2442 raft_consensus.cc:993] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:10.463127 2442 raft_consensus.cc:1081] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 5 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:10.464843 30489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:58:10.465328 30489 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:10.465762 30489 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:10.468325 2426 tablet_copy_client.cc:806] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:58:10.468909 2426 tablet_copy_client.cc:670] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:58:10.482501 2453 tablet_copy_client.cc:323] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
I20260807 07:58:10.484306 30502 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet 1d130f3994424c29b619c9f702310fc9 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
I20260807 07:58:10.484826 30502 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet 1d130f3994424c29b619c9f702310fc9 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-1d130f3994424c29b619c9f702310fc9
I20260807 07:58:10.493034 30502 tablet_copy_source_session.cc:215] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:58:10.489801 30489 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:10.499271 30489 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:10.508363 2453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d130f3994424c29b619c9f702310fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:58:10.510215 2434 raft_consensus.cc:1064] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:58:10.528730 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:10.529417 30366 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:10.530966 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:10.538594 30581 raft_consensus.cc:3055] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:10.538879 30581 raft_consensus.cc:740] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:10.559859 2419 raft_consensus.cc:993] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:10.569147 2426 tablet_copy_client.cc:538] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:58:10.571774 30581 consensus_queue.cc:260] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:10.573150 30581 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:10.577601 2419 raft_consensus.cc:1081] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:10.579347 2434 consensus_queue.cc:237] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:10.588635 30578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34594
I20260807 07:58:10.589208 30578 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:10.589578 30578 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:10.593972 30366 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:10.596107 30578 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:10.597958 30578 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:10.603458 2426 tablet_bootstrap.cc:492] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:58:10.606940 30581 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:10.609722 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:10.610348 30489 raft_consensus.cc:3055] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:58:10.610651 30489 raft_consensus.cc:740] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:10.613147 30429 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:10.628038 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:10.628809 30363 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:10.611486 30489 consensus_queue.cc:260] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:10.628654 2252 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:10.635382 2252 raft_consensus.cc:697] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:10.636317 2252 consensus_queue.cc:237] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:10.650267 30489 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:10.650548 31382 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 07:58:10.656186 2393 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:10.669226 2163 raft_consensus.cc:993] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:10.669775 2422 raft_consensus.cc:1081] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:10.648555 30363 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:58:10.699018 30487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:58:10.699579 30487 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:10.699922 30487 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:10.714514 2486 ts_tablet_manager.cc:933] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:10.716163 30489 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:58:10.743225 30487 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:10.749333 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:10.750051 31383 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:10.753232 30487 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:10.766723 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 143911us
I20260807 07:58:10.770336 30539 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:10.778215 2474 raft_consensus.cc:2804] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:58:10.778735 2474 raft_consensus.cc:697] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:10.779568 2474 consensus_queue.cc:237] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:10.783018 2453 tablet_copy_client.cc:806] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:58:10.783631 2453 tablet_copy_client.cc:670] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:58:10.784808 31383 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:10.801584 2453 tablet_copy_client.cc:538] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:58:10.793509 30430 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:10.813655 2433 raft_consensus.cc:2804] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:10.814452 2433 raft_consensus.cc:697] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:10.815376 2433 consensus_queue.cc:237] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:10.821323 2486 tablet_copy_client.cc:323] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
I20260807 07:58:10.827822 30222 catalog_manager.cc:5697] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 5 to 6, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:10.838572 30363 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260807 07:58:10.838927 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 125810us
I20260807 07:58:10.849318 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:10.849972 30367 raft_consensus.cc:3055] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:10.850270 30367 raft_consensus.cc:740] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:10.851717 30502 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet 5b78e546552f4ce38217f522549d6f36 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
I20260807 07:58:10.852310 30502 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet 5b78e546552f4ce38217f522549d6f36 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-5b78e546552f4ce38217f522549d6f36
I20260807 07:58:10.853826 30367 consensus_queue.cc:260] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:10.861289 30367 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:10.874413 30367 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:10.875399 2453 tablet_bootstrap.cc:492] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
W20260807 07:58:10.927371 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 51384.7us
W20260807 07:58:10.940688 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 98549.6us
W20260807 07:58:11.001861 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 71687.3us
I20260807 07:58:11.004244 2434 raft_consensus.cc:993] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:11.004698 2434 raft_consensus.cc:1081] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:11.006536 2434 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260807 07:58:11.030369 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 101821us
I20260807 07:58:11.044451 30581 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 07:58:11.056157 30364 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:11.069689 30364 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:11.070125 30364 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:11.078913 30364 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:11.098588 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:11.099300 30487 raft_consensus.cc:3055] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Stepping down as leader of term 9
I20260807 07:58:11.099604 30487 raft_consensus.cc:740] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:11.098670 30364 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:11.087267 30502 tablet_copy_source_session.cc:215] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:58:11.114733 30487 consensus_queue.cc:260] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:11.135964 30487 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Advancing to term 10
W20260807 07:58:11.144280 30428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:58:11.149770 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 62896.3us
I20260807 07:58:11.152470 30487 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 10.
I20260807 07:58:11.159730 30317 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:11.166627 2328 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 07:58:11.173089 2328 raft_consensus.cc:697] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 10 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:11.188787 2328 consensus_queue.cc:237] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:11.199200 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:11.204950 2486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b78e546552f4ce38217f522549d6f36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:58:11.199832 30584 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:11.211544 2479 raft_consensus.cc:2955] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:11.214010 30578 raft_consensus.cc:1275] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:58:11.225786 2519 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:11.232555 30480 raft_consensus.cc:1275] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:58:11.232758 30584 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 10.
I20260807 07:58:11.235138 2497 consensus_queue.cc:1048] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:58:11.250855 30363 raft_consensus.cc:2955] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:11.254650 31380 raft_consensus.cc:2955] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:11.252816 30364 raft_consensus.cc:1275] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:58:11.246244 30220 catalog_manager.cc:5697] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e reported cstate change: term changed from 4 to 5, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 5 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:58:11.255978 2501 consensus_queue.cc:1048] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260807 07:58:11.265738 30222 catalog_manager.cc:5697] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 6 to 7, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:11.279785 2426 tablet_bootstrap.cc:492] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:58:11.280804 2426 tablet_bootstrap.cc:492] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:58:11.283629 2426 ts_tablet_manager.cc:1403] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.680s user 0.028s sys 0.035s
I20260807 07:58:11.312008 30220 catalog_manager.cc:5697] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:11.287659 2426 raft_consensus.cc:359] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:58:11.318738 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 65592us
I20260807 07:58:11.315281 2426 raft_consensus.cc:740] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:58:11.325023 30223 catalog_manager.cc:5697] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 9 to 10, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 10 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:11.331073 30367 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:11.326923 2486 tablet_copy_client.cc:806] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:58:11.347142 30578 raft_consensus.cc:2955] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:11.354768 2477 consensus_queue.cc:1048] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260807 07:58:11.357255 2426 consensus_queue.cc:260] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:11.360025 2426 ts_tablet_manager.cc:1434] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.076s user 0.000s sys 0.007s
W20260807 07:58:11.371959 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 46335.2us
I20260807 07:58:11.364605 2486 tablet_copy_client.cc:670] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
W20260807 07:58:11.377737 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 50123.4us
I20260807 07:58:11.341497 2419 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260807 07:58:11.393906 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 54086us
I20260807 07:58:11.424743 2486 tablet_copy_client.cc:538] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:58:11.429718 30386 tablet_copy_service.cc:342] P b1188d7d3a0b455894bc443d571f6a19: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-d0f6bb896213415485f2dee06ba250b8 received from {username='slave'} at 127.0.0.1:33338
I20260807 07:58:11.430243 30386 tablet_copy_service.cc:434] P b1188d7d3a0b455894bc443d571f6a19: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-d0f6bb896213415485f2dee06ba250b8 on tablet d0f6bb896213415485f2dee06ba250b8 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:11.437840 30366 raft_consensus.cc:1275] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:58:11.469234 2453 tablet_bootstrap.cc:492] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:58:11.470322 2453 tablet_bootstrap.cc:492] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:58:11.508767 31383 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:11.512650 2511 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260807 07:58:11.540012 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 84493.5us
I20260807 07:58:11.543359 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:11.537623 2453 ts_tablet_manager.cc:1403] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.662s user 0.023s sys 0.056s
W20260807 07:58:11.569890 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 112553us
I20260807 07:58:11.558526 2474 consensus_queue.cc:1048] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260807 07:58:11.579571 2486 tablet_bootstrap.cc:492] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:58:11.572885 2453 raft_consensus.cc:359] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:11.624816 2453 raft_consensus.cc:740] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:58:11.627204 2453 consensus_queue.cc:260] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:11.639638 30489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:11.640307 30489 raft_consensus.cc:606] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:11.641103 2453 ts_tablet_manager.cc:1434] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.083s user 0.004s sys 0.002s
I20260807 07:58:11.647313 30502 tablet_copy_service.cc:342] P ef1ca7acf52a438f89f14707e9e06818: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-1d130f3994424c29b619c9f702310fc9 received from {username='slave'} at 127.0.0.1:34358
I20260807 07:58:11.647773 30502 tablet_copy_service.cc:434] P ef1ca7acf52a438f89f14707e9e06818: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-1d130f3994424c29b619c9f702310fc9 on tablet 1d130f3994424c29b619c9f702310fc9 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:11.659957 30584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:11.660563 30584 raft_consensus.cc:606] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:11.665710 30489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:11.666281 30489 raft_consensus.cc:606] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:11.670481 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 07:58:11.672531 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:11.673288 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:11.690407 2519 raft_consensus.cc:993] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:11.690907 2519 raft_consensus.cc:1081] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:11.700286 30578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34594
I20260807 07:58:11.700902 30578 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:11.701313 30578 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:11.714951 31382 raft_consensus.cc:1217] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7] Dedup: 8.7->[]
I20260807 07:58:11.759706 30578 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:11.779021 30487 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260807 07:58:11.780761 2539 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 07:58:11.784842 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:11.785504 30363 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:11.786613 30578 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:11.807744 30363 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:58:11.815994 30487 consensus_queue.cc:237] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:11.822757 31382 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:11.823804 30578 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:11.826851 2500 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:11.830842 2519 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:11.852051 30582 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260807 07:58:11.881678 31383 raft_consensus.cc:1217] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260807 07:58:11.876873 30541 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:11.889503 2420 raft_consensus.cc:2804] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:58:11.890064 2420 raft_consensus.cc:697] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:11.890208 2492 raft_consensus.cc:993] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:11.895323 2492 raft_consensus.cc:1081] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:11.907821 2420 consensus_queue.cc:237] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:11.903590 2539 consensus_queue.cc:1048] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260807 07:58:11.912089 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:11.914721 30487 raft_consensus.cc:3055] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:58:11.915014 30487 raft_consensus.cc:740] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:11.910422 2479 raft_consensus.cc:2955] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:11.919827 30581 raft_consensus.cc:2955] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:11.929949 30487 consensus_queue.cc:260] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:11.935912 30487 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:11.944446 30477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:58:11.945142 30477 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:11.945550 30477 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:11.957288 30487 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:58:11.963342 30477 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:11.988946 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:11.989068 30477 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:11.989554 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:11.990134 31383 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:11.989629 30581 raft_consensus.cc:3055] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:11.990705 30581 raft_consensus.cc:740] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:11.991451 30581 consensus_queue.cc:260] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:11.992514 30581 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:11.999657 31383 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:12.005414 30581 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:12.006857 30429 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:12.013350 2519 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:12.014004 2519 raft_consensus.cc:697] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:12.057204 2519 consensus_queue.cc:237] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:12.097289 2393 raft_consensus.cc:993] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:12.097997 2393 raft_consensus.cc:1081] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:12.100049 30363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:12.100596 30363 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:12.100943 30363 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:12.102329 31382 raft_consensus.cc:2955] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:58:12.108515 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 66916.4us
I20260807 07:58:12.114445 30201 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 151ecad19f9e4079986c980524b2f3c0 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:58:12.123703 30363 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:12.127028 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:12.127663 30487 raft_consensus.cc:3055] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:12.127940 30487 raft_consensus.cc:740] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:12.128911 30487 consensus_queue.cc:260] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:12.129832 30487 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:12.153314 30487 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:12.154588 30317 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:12.155345 2534 raft_consensus.cc:2804] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:12.173125 30363 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:12.174736 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:12.174885 2534 raft_consensus.cc:697] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:12.175333 31383 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:12.143882 30222 catalog_manager.cc:5697] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 4, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 4 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:58:12.176313 2534 consensus_queue.cc:237] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:12.195161 30223 catalog_manager.cc:5697] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 6 to 7, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:12.197913 30220 catalog_manager.cc:5697] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 7 to 8, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 8 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:12.205225 31383 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:12.239771 30221 catalog_manager.cc:5697] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 6 to 7, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:12.256811 2486 tablet_bootstrap.cc:492] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:58:12.258437 2486 tablet_bootstrap.cc:492] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:58:12.269466 2532 raft_consensus.cc:1064] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:58:12.279801 2532 consensus_queue.cc:237] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:12.259404 2486 ts_tablet_manager.cc:1403] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.701s user 0.026s sys 0.035s
I20260807 07:58:12.315055 2486 raft_consensus.cc:359] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:12.316349 2486 raft_consensus.cc:740] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:58:12.317449 2486 consensus_queue.cc:260] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:12.321486 30584 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 07:58:12.323309 31382 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 07:58:12.324141 2534 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:12.329212 2538 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:12.334316 30477 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 07:58:12.336472 30480 raft_consensus.cc:1275] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:58:12.338267 2474 consensus_queue.cc:1048] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:12.341584 2422 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:12.402901 30367 raft_consensus.cc:1275] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:58:12.405824 2562 consensus_queue.cc:1048] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:58:12.409304 2538 raft_consensus.cc:2955] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:12.411191 31383 raft_consensus.cc:2955] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:12.432885 30345 tablet_service.cc:1558] Processing DeleteTablet for tablet 151ecad19f9e4079986c980524b2f3c0 with delete_type TABLET_DATA_TOMBSTONED (TS b1188d7d3a0b455894bc443d571f6a19 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:45034
I20260807 07:58:12.438905 2486 ts_tablet_manager.cc:1434] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.153s user 0.000s sys 0.008s
I20260807 07:58:12.449584 30502 tablet_copy_service.cc:342] P ef1ca7acf52a438f89f14707e9e06818: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-5b78e546552f4ce38217f522549d6f36 received from {username='slave'} at 127.0.0.1:34358
I20260807 07:58:12.450045 30502 tablet_copy_service.cc:434] P ef1ca7acf52a438f89f14707e9e06818: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-5b78e546552f4ce38217f522549d6f36 on tablet 5b78e546552f4ce38217f522549d6f36 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
W20260807 07:58:12.455283 2577 log.cc:927] Time spent T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
I20260807 07:58:12.460398 30223 catalog_manager.cc:5697] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 7 to 8, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:12.491380 2582 tablet_replica.cc:333] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19: stopping tablet replica
I20260807 07:58:12.492745 30578 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:12.493438 2519 raft_consensus.cc:1064] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:58:12.498675 2511 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:12.506770 30480 raft_consensus.cc:2955] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:12.497329 2519 consensus_queue.cc:237] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:12.531142 30582 raft_consensus.cc:2955] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:12.574429 30367 consensus_queue.cc:237] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:12.565070 2582 raft_consensus.cc:2243] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:12.583832 2582 raft_consensus.cc:2272] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:12.589078 31383 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:58:12.592373 30582 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:58:12.602442 2534 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260807 07:58:12.603438 2422 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:12.609253 2582 ts_tablet_manager.cc:1916] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:12.620371 2538 raft_consensus.cc:2955] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:12.628947 31380 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:12.629005 31382 raft_consensus.cc:1217] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Deduplicated request from leader. Original: 6.5->[6.6-6.6] Dedup: 6.6->[]
I20260807 07:58:12.631492 30578 raft_consensus.cc:2955] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:12.631714 31384 raft_consensus.cc:2955] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:12.634706 2519 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:12.631780 31383 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 LEARNER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 07:58:12.639873 2511 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:12.643874 30363 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 07:58:12.648078 2511 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:12.671548 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d0f6bb896213415485f2dee06ba250b8 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:58:12.678012 30584 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260807 07:58:12.698793 31380 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:58:12.701172 2500 raft_consensus.cc:2955] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:12.703126 30220 catalog_manager.cc:5697] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index 8 to 9, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New cstate: current_term: 8 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:12.705957 2422 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:12.713696 30487 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:58:12.718418 2425 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260807 07:58:12.723117 30459 tablet_service.cc:1558] Processing DeleteTablet for tablet d0f6bb896213415485f2dee06ba250b8 with delete_type TABLET_DATA_TOMBSTONED (TS ef1ca7acf52a438f89f14707e9e06818 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:33906
I20260807 07:58:12.708554 31380 raft_consensus.cc:2955] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:12.730602 2582 ts_tablet_manager.cc:1929] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260807 07:58:12.731055 2582 log.cc:1199] T 151ecad19f9e4079986c980524b2f3c0 P b1188d7d3a0b455894bc443d571f6a19: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root/wals/151ecad19f9e4079986c980524b2f3c0
I20260807 07:58:12.732801 30203 catalog_manager.cc:5028] TS b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): tablet 151ecad19f9e4079986c980524b2f3c0 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:12.742770 2511 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:12.747931 30367 raft_consensus.cc:2955] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:58:12.754070 2585 log.cc:927] Time spent T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.063s user 0.000s sys 0.000s
I20260807 07:58:12.778151 2592 tablet_replica.cc:333] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818: stopping tablet replica
I20260807 07:58:12.782294 2592 raft_consensus.cc:2243] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:12.783998 2592 raft_consensus.cc:2272] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:12.790040 30220 catalog_manager.cc:5697] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:12.792398 30582 raft_consensus.cc:2955] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:12.802492 2592 ts_tablet_manager.cc:1916] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:12.857270 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:12.863656 2592 ts_tablet_manager.cc:1929] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260807 07:58:12.864164 2592 log.cc:1199] T d0f6bb896213415485f2dee06ba250b8 P ef1ca7acf52a438f89f14707e9e06818: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root/wals/d0f6bb896213415485f2dee06ba250b8
I20260807 07:58:12.866369 30201 catalog_manager.cc:5028] TS ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): tablet d0f6bb896213415485f2dee06ba250b8 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:13.024281 30363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:13.024915 30363 raft_consensus.cc:606] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:13.031440 30363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:13.031993 30363 raft_consensus.cc:606] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:13.034788 30584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:13.035322 30584 raft_consensus.cc:606] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:13.038317 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:13.038851 30480 raft_consensus.cc:606] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Received request to transfer leadership to TS 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:13.040366 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260807 07:58:13.042181 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:13.045668 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:13.154726 2501 raft_consensus.cc:1064] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:58:13.163546 2501 consensus_queue.cc:237] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:13.225198 2561 raft_consensus.cc:993] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:13.234766 30584 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:13.235100 30363 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:13.230600 2546 raft_consensus.cc:1081] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:13.250443 31380 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:13.261816 2500 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260807 07:58:13.288730 30480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:58:13.289362 30480 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:13.289752 30480 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:13.293476 2501 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:13.294935 2393 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:13.300428 30480 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:13.293112 30487 consensus_queue.cc:237] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:13.316315 30480 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:13.319550 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:13.320168 30582 raft_consensus.cc:3055] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:13.320418 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:13.320438 30582 raft_consensus.cc:740] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:13.322522 30582 consensus_queue.cc:260] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:13.321056 31380 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:13.337744 30582 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:13.341288 31382 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 07:58:13.343163 30578 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260807 07:58:13.359474 30582 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:13.361254 30429 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:13.362423 2598 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:13.373416 2519 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260807 07:58:13.405368 2393 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260807 07:58:13.414752 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 66667.4us
I20260807 07:58:13.409325 2511 raft_consensus.cc:993] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower 6bd20e9c0d3e4ace86fc1f55ab9425fa to start an election
I20260807 07:58:13.445753 2511 raft_consensus.cc:1081] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Signalling peer 6bd20e9c0d3e4ace86fc1f55ab9425fa to start an election
W20260807 07:58:13.448060 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 82968.4us
I20260807 07:58:13.448307 31383 raft_consensus.cc:2955] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:13.460785 2598 raft_consensus.cc:697] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:13.446740 2511 raft_consensus.cc:2955] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:13.468780 31384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94"
dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
from {username='slave'} at 127.0.0.1:59392
I20260807 07:58:13.469353 31384 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:13.469727 31384 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:13.429032 31380 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:13.479908 31384 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:13.488536 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:13.489238 30480 raft_consensus.cc:3055] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:58:13.489610 30480 raft_consensus.cc:740] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:13.490499 30480 consensus_queue.cc:260] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:13.491475 30480 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:13.498468 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:13.499075 30582 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:13.481300 30222 catalog_manager.cc:5697] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 4 to 5, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New cstate: current_term: 2 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:13.502600 31384 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:13.514669 30582 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 5.
I20260807 07:58:13.517349 30480 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 5.
I20260807 07:58:13.519472 30588 raft_consensus.cc:1240] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:58:13.517858 31338 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:13.528877 2600 raft_consensus.cc:2804] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:58:13.529471 2600 raft_consensus.cc:697] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:13.530361 2600 consensus_queue.cc:237] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:13.513136 2598 consensus_queue.cc:237] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:13.572258 30201 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d130f3994424c29b619c9f702310fc9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260807 07:58:13.573436 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 112652us
W20260807 07:58:13.573792 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 46128.7us
W20260807 07:58:13.608302 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 88871.1us
I20260807 07:58:13.633589 2425 raft_consensus.cc:993] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:13.662660 2519 raft_consensus.cc:2955] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:13.677879 31380 raft_consensus.cc:2955] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:13.670189 2425 raft_consensus.cc:1081] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:13.732244 2620 raft_consensus.cc:993] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:13.753953 30222 catalog_manager.cc:5697] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 4 to 5, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 5 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:13.739521 2620 raft_consensus.cc:1081] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:13.770046 30487 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:58:13.770592 30487 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:13.770939 30487 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:13.779584 30584 raft_consensus.cc:2955] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:13.805444 30582 raft_consensus.cc:2955] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:13.812680 30487 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:13.815873 30487 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:13.817410 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:13.818089 31382 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Advancing to term 8
W20260807 07:58:13.822633 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 48577.8us
I20260807 07:58:13.832146 30222 catalog_manager.cc:5697] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e reported cstate change: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:13.863379 31382 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:13.885265 30220 catalog_manager.cc:5697] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 6 to 7, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:13.891300 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:13.891888 30367 raft_consensus.cc:3055] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:13.892258 30367 raft_consensus.cc:740] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:13.892941 30367 consensus_queue.cc:260] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:13.894003 30367 raft_consensus.cc:3060] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:13.901847 30367 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:13.904263 30487 raft_consensus.cc:1240] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:13.910949 30430 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:13.916339 2628 raft_consensus.cc:2804] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:13.916862 2628 raft_consensus.cc:697] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:13.917680 2628 consensus_queue.cc:237] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:13.927179 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 342870us
I20260807 07:58:13.934458 30581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:58:13.935101 30581 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:13.935485 30581 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:13.945791 30367 raft_consensus.cc:2955] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:13.947757 30581 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:13.956425 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:13.956907 30581 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:13.957082 31380 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:13.969106 30345 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d130f3994424c29b619c9f702310fc9 with delete_type TABLET_DATA_TOMBSTONED (TS b1188d7d3a0b455894bc443d571f6a19 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45034
I20260807 07:58:13.975852 31380 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:58:13.982506 30542 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:13.984617 2611 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:13.985873 31382 raft_consensus.cc:1240] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 6. Current term is 7. Ops: []
I20260807 07:58:13.985175 2611 raft_consensus.cc:697] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:13.989594 2611 consensus_queue.cc:237] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:13.998873 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:14.009665 2632 consensus_queue.cc:1059] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260807 07:58:14.048444 30364 raft_consensus.cc:3055] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:14.048885 30364 raft_consensus.cc:740] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:14.051008 30364 consensus_queue.cc:260] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:14.068110 30364 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
W20260807 07:58:14.070222 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 50707.4us
I20260807 07:58:14.089188 30581 raft_consensus.cc:1240] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 6. Current term is 7. Ops: []
I20260807 07:58:14.097028 30223 catalog_manager.cc:5697] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 6 to 7, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 7 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:14.075771 2647 tablet_replica.cc:333] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19: stopping tablet replica
I20260807 07:58:14.100890 30364 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
W20260807 07:58:14.101544 2632 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260807 07:58:14.107280 2647 raft_consensus.cc:2243] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:14.108085 2647 raft_consensus.cc:2272] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:14.108503 30480 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:58:14.110914 2647 ts_tablet_manager.cc:1916] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:14.114655 2596 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:14.159322 2647 ts_tablet_manager.cc:1929] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260807 07:58:14.159942 2647 log.cc:1199] T 1d130f3994424c29b619c9f702310fc9 P b1188d7d3a0b455894bc443d571f6a19: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root/wals/1d130f3994424c29b619c9f702310fc9
I20260807 07:58:14.165983 30220 catalog_manager.cc:5697] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 7 to 8, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 8 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:14.172871 30582 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:58:14.178508 2506 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:14.180040 30203 catalog_manager.cc:5028] TS b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): tablet 1d130f3994424c29b619c9f702310fc9 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:14.193219 30487 consensus_queue.cc:237] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:14.205619 30358 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 07:58:14.206634 31382 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 07:58:14.207614 2643 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:14.209295 2393 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:14.210469 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:14.221271 31382 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 07:58:14.226516 30584 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 07:58:14.227038 2628 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:14.230953 2628 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:14.252926 2393 raft_consensus.cc:2955] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:14.255438 31380 raft_consensus.cc:2955] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:14.275043 30201 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b78e546552f4ce38217f522549d6f36 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:58:14.276135 30358 raft_consensus.cc:2955] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:14.344507 30222 catalog_manager.cc:5697] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index 7 to 8, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:14.376807 31380 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:58:14.379259 2598 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:14.381088 30564 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b78e546552f4ce38217f522549d6f36 with delete_type TABLET_DATA_TOMBSTONED (TS f831a53ec51d452398015797d543164e not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:34588
I20260807 07:58:14.392756 30366 raft_consensus.cc:1275] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:58:14.395851 2644 consensus_queue.cc:1048] T 24224c3e18ec49578bb6c7bd4fd217b5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:14.401844 31380 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 07:58:14.404099 2561 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:14.417474 30584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:14.418118 30584 raft_consensus.cc:606] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 4 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:14.422027 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:14.422672 30480 raft_consensus.cc:606] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:14.441923 30364 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260807 07:58:14.451712 30366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:14.452368 30366 raft_consensus.cc:606] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:14.454188 2611 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260807 07:58:14.454855 2661 tablet_replica.cc:333] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e: stopping tablet replica
I20260807 07:58:14.456342 2661 raft_consensus.cc:2243] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:14.469942 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 07:58:14.493435 2661 raft_consensus.cc:2272] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:14.472636 2632 raft_consensus.cc:993] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:14.495002 2632 raft_consensus.cc:1081] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:14.494498 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:14.496279 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:14.519850 2661 ts_tablet_manager.cc:1916] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:14.548780 30582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:58:14.549458 30582 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:14.549801 30582 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:14.563923 2661 ts_tablet_manager.cc:1929] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.7
I20260807 07:58:14.569607 2661 log.cc:1199] T 5b78e546552f4ce38217f522549d6f36 P f831a53ec51d452398015797d543164e: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root/wals/5b78e546552f4ce38217f522549d6f36
I20260807 07:58:14.571448 30203 catalog_manager.cc:5028] TS f831a53ec51d452398015797d543164e (127.27.64.131:33207): tablet 5b78e546552f4ce38217f522549d6f36 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:14.578677 30582 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:14.601640 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:14.602319 30487 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:14.610548 30487 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:58:14.621729 30480 raft_consensus.cc:1240] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:14.628368 30539 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:14.629441 2546 raft_consensus.cc:2804] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:14.630040 2546 raft_consensus.cc:697] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:14.630923 2546 consensus_queue.cc:237] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:14.637012 2632 consensus_queue.cc:1059] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:14.638329 2640 raft_consensus.cc:3055] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:14.638723 2640 raft_consensus.cc:740] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:14.639547 2640 consensus_queue.cc:260] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:14.640515 2640 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:14.664798 30582 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:58:15.300935 30541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s user 0.113s sys 0.135s
W20260807 07:58:15.320559 30541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s user 0.114s sys 0.135s
W20260807 07:58:15.327921 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 653515us
W20260807 07:58:15.401989 31338 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s user 0.007s sys 0.004s
W20260807 07:58:15.402522 31338 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s user 0.007s sys 0.004s
W20260807 07:58:15.441169 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:15.446194 30489 raft_consensus.cc:1275] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:58:15.479076 30222 catalog_manager.cc:5697] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e reported cstate change: term changed from 5 to 6, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:58:15.507448 30582 consensus_queue.cc:237] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:15.538877 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:15.553237 30366 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:58:15.556404 30358 raft_consensus.cc:1275] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260807 07:58:15.659049 30542 consensus_peers.cc:597] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 61ca595a07a748bb83b4aa11cb066270. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:58:15.698539 2682 raft_consensus.cc:993] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:15.699669 2644 raft_consensus.cc:1081] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:15.702639 30358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:15.703209 30358 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:15.703552 30358 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:15.712385 2676 raft_consensus.cc:993] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:15.712893 2676 raft_consensus.cc:1081] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 4 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:15.720238 2611 consensus_queue.cc:1048] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:15.721976 30366 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:58:15.728376 30358 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:15.730345 2694 consensus_queue.cc:1048] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:15.742144 2611 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:15.750214 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:15.750803 30477 raft_consensus.cc:3055] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:15.751067 30477 raft_consensus.cc:740] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:15.751737 30477 consensus_queue.cc:260] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:15.752804 30477 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:15.753026 30488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:58:15.753633 30488 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:15.753969 30488 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:15.758227 30489 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:58:15.762144 30358 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:15.762218 30477 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:15.764364 30317 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:15.766355 2611 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:58:15.766448 30488 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:15.769752 30488 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:15.770232 2697 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:15.772182 2697 raft_consensus.cc:697] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:15.773075 2697 consensus_queue.cc:237] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:15.792203 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:15.792833 30584 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:15.795104 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:15.795728 30364 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:15.797938 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:15.798508 30581 raft_consensus.cc:3055] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:58:15.798789 30581 raft_consensus.cc:740] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:15.799434 30581 consensus_queue.cc:260] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:15.802145 30581 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:15.810683 2686 raft_consensus.cc:2955] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:15.827527 30584 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:15.828136 30364 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:58:15.838511 30581 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
W20260807 07:58:15.842415 30294 auto_rebalancer.cc:644] Failed to schedule move for tablet 02ec7850a44f4310aa712fd0c381c65c: Illegal state: Replica f831a53ec51d452398015797d543164e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:58:15.849900 30364 consensus_queue.cc:237] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:15.852393 30490 raft_consensus.cc:2955] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
W20260807 07:58:15.865428 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 58390.2us
W20260807 07:58:15.870043 30323 consensus_peers.cc:597] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5cb72552d8da48b78c58110bb0c84f61. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:58:15.870023 30490 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:58:15.875538 2640 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:15.813851 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:15.887924 30429 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:15.890640 2682 raft_consensus.cc:2804] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:58:15.891131 2682 raft_consensus.cc:697] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:15.891990 2682 consensus_queue.cc:237] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:15.896837 30223 catalog_manager.cc:5697] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 6 to 7, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:15.901736 30221 catalog_manager.cc:5697] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:15.917956 30582 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260807 07:58:15.921298 2723 log.cc:927] Time spent T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
W20260807 07:58:15.937549 2714 log.cc:927] Time spent T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.070s user 0.006s sys 0.000s
I20260807 07:58:15.938268 2696 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:58:15.929184 2697 raft_consensus.cc:2955] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:15.949556 30366 raft_consensus.cc:2955] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:15.958559 30223 catalog_manager.cc:5697] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 4 to 5, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:16.003428 30490 raft_consensus.cc:2955] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:16.008504 30488 consensus_queue.cc:237] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:16.026805 30223 catalog_manager.cc:5697] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 5 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:16.030177 30581 raft_consensus.cc:2955] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
W20260807 07:58:16.056784 30430 consensus_peers.cc:597] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f16f3d2817a34261bb25577fa0f9e2de. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:58:16.058565 30590 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 07:58:16.063921 2731 ts_tablet_manager.cc:933] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:16.070099 30358 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 07:58:16.071571 2393 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:16.078773 2682 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:16.095847 2393 raft_consensus.cc:2955] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:16.125119 2731 tablet_copy_client.cc:323] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.131:33207
I20260807 07:58:16.124917 30223 catalog_manager.cc:5697] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index -1 to 7, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New cstate: current_term: 8 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:16.128106 30605 tablet_copy_service.cc:140] P f831a53ec51d452398015797d543164e: Received BeginTabletCopySession request for tablet 61ca595a07a748bb83b4aa11cb066270 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:42218)
I20260807 07:58:16.128659 30605 tablet_copy_service.cc:161] P f831a53ec51d452398015797d543164e: Beginning new tablet copy session on tablet 61ca595a07a748bb83b4aa11cb066270 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:42218: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-61ca595a07a748bb83b4aa11cb066270
I20260807 07:58:16.107448 30358 raft_consensus.cc:2955] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:16.146088 30605 tablet_copy_source_session.cc:215] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:58:16.151364 2731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61ca595a07a748bb83b4aa11cb066270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:58:16.152611 30584 raft_consensus.cc:2955] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:16.159744 30590 raft_consensus.cc:1275] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:16.161150 2696 consensus_queue.cc:1048] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:16.292034 2731 tablet_copy_client.cc:806] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:58:16.324193 2731 tablet_copy_client.cc:670] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:58:16.337118 2731 tablet_copy_client.cc:538] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:58:16.353739 2731 tablet_bootstrap.cc:492] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:58:16.388454 30584 raft_consensus.cc:1275] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:58:16.390312 2682 consensus_queue.cc:1048] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:58:16.401861 2731 tablet_bootstrap.cc:492] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:58:16.403396 2731 tablet_bootstrap.cc:492] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:58:16.404593 2731 ts_tablet_manager.cc:1403] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.051s user 0.027s sys 0.015s
W20260807 07:58:16.560632 30402 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2b40 after lost signal to thread 27911
W20260807 07:58:16.744849 30402 debug-util.cc:398] Leaking SignalData structure 0x7b0800315dc0 after lost signal to thread 30272
W20260807 07:58:16.746405 30402 debug-util.cc:398] Leaking SignalData structure 0x7b0800275da0 after lost signal to thread 30405
W20260807 07:58:16.752630 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 326318us
I20260807 07:58:16.760453 2731 raft_consensus.cc:359] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:16.761341 2731 raft_consensus.cc:740] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:58:16.762034 2731 consensus_queue.cc:260] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:16.764603 2731 ts_tablet_manager.cc:1434] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.360s user 0.004s sys 0.007s
W20260807 07:58:16.779331 30402 debug-util.cc:398] Leaking SignalData structure 0x7b0800042da0 after lost signal to thread 30521
W20260807 07:58:16.814296 30402 debug-util.cc:398] Leaking SignalData structure 0x7b080033b060 after lost signal to thread 30627
W20260807 07:58:16.825218 30402 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2cc0 after lost signal to thread 31418
I20260807 07:58:16.854328 30605 tablet_copy_service.cc:342] P f831a53ec51d452398015797d543164e: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-61ca595a07a748bb83b4aa11cb066270 received from {username='slave'} at 127.0.0.1:42218
I20260807 07:58:16.854904 30605 tablet_copy_service.cc:434] P f831a53ec51d452398015797d543164e: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-61ca595a07a748bb83b4aa11cb066270 on tablet 61ca595a07a748bb83b4aa11cb066270 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:16.897863 30365 raft_consensus.cc:1275] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:58:16.995170 2747 consensus_queue.cc:1048] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:58:17.000602 2747 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:17.004087 2747 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:17.008100 2747 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:17.307657 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 332068us
W20260807 07:58:17.739830 30323 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s user 0.008s sys 0.062s
W20260807 07:58:17.740361 30323 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s user 0.008s sys 0.062s
I20260807 07:58:17.827586 2757 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:17.828722 2757 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:17.831262 2757 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:17.831928 2757 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:17.832470 2747 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:17.833835 2747 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:17.836220 2747 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:17.836700 2760 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:17.837231 2747 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:17.833181 2757 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:17.842427 2747 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:17.845024 2747 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:17.837497 2760 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:17.845587 2747 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:17.891063 2757 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:17.891526 2766 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:17.901773 2747 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:17.904428 2747 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:17.905422 2767 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:17.906275 2767 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:17.909024 2767 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:17.912196 2760 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:17.925556 2757 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:17.929466 2757 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:17.932152 2757 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:17.936153 30586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 2424) took 1015 ms. Trace:
I20260807 07:58:17.947381 30586 rpcz_store.cc:276] 0807 07:58:16.920263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:17.934723 (+1014460us) service_pool.cc:224] Handling call
0807 07:58:17.935257 (+ 534us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:17.935583 (+ 326us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:17.935623 (+ 40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:17.935696 (+ 73us) raft_consensus.cc:1645] Marking committed up to 6
0807 07:58:17.935737 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:17.935802 (+ 65us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:17.935961 (+ 159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:58:17.939278 30579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34604 (request call id 2132) took 1016 ms. Trace:
I20260807 07:58:17.949601 30579 rpcz_store.cc:276] 0807 07:58:16.922902 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:16.924887 (+ 1985us) service_pool.cc:224] Handling call
0807 07:58:16.925220 (+ 333us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:17.938755 (+1013535us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:17.938790 (+ 35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:17.938834 (+ 44us) raft_consensus.cc:1645] Marking committed up to 6
0807 07:58:17.938867 (+ 33us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:17.938930 (+ 63us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:17.939059 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:58:17.940084 2766 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:17.940924 30428 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.857s user 0.000s sys 0.053s
W20260807 07:58:17.975245 30428 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.994s user 0.000s sys 0.054s
I20260807 07:58:17.978201 2766 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:17.945678 2767 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
W20260807 07:58:17.967661 30518 debug-util.cc:398] Leaking SignalData structure 0x7b08003320e0 after lost signal to thread 27911
W20260807 07:58:17.983083 30518 debug-util.cc:398] Leaking SignalData structure 0x7b0800323b40 after lost signal to thread 30272
I20260807 07:58:17.984200 2767 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:17.986533 2767 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.048308 2769 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:18.048712 2697 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:18.049535 2697 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.050966 2770 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.052068 30578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34604 (request call id 2134) took 1128 ms. Trace:
I20260807 07:58:18.051748 2770 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:18.060619 2762 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.052536 30578 rpcz_store.cc:276] 0807 07:58:16.923744 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:16.928859 (+ 5115us) service_pool.cc:224] Handling call
0807 07:58:16.929282 (+ 423us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:18.051506 (+1122224us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:18.051547 (+ 41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:18.051597 (+ 50us) raft_consensus.cc:1645] Marking committed up to 4
0807 07:58:18.051634 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:18.051709 (+ 75us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:18.051863 (+ 154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:58:18.063462 2762 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.064538 2763 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.065246 2763 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.068768 2763 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.069267 2770 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.069833 2770 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.070474 2770 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.072652 2770 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.075181 2763 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:18.076012 2763 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.077093 30585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34604 (request call id 2129) took 1155 ms. Trace:
I20260807 07:58:18.077584 30585 rpcz_store.cc:276] 0807 07:58:16.921221 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:18.075502 (+1154281us) service_pool.cc:224] Handling call
0807 07:58:18.076026 (+ 524us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:18.076512 (+ 486us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:18.076545 (+ 33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:18.076613 (+ 68us) raft_consensus.cc:1645] Marking committed up to 4
0807 07:58:18.076683 (+ 70us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:18.076749 (+ 66us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:18.076877 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:58:18.078665 2763 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.049261 2769 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.079222 2763 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.080281 30584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42218 (request call id 551) took 1167 ms. Trace:
I20260807 07:58:18.080930 2769 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.066922 2766 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.074455 2776 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.082043 2766 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.082473 2776 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.052449 2697 leader_election.cc:290] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.084256 2697 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:18.084949 2697 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.087404 2697 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.087994 2697 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.088147 30489 raft_consensus.cc:1275] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:18.089550 2747 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.088682 2697 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.090473 2762 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.090329 2747 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.091012 2762 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.091852 2697 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.089425 2760 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.092413 2697 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.092557 2747 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.092922 2760 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:18.093230 2697 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.095683 2697 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.062070 2767 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:18.096199 2760 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.079970 2763 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.093312 2772 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.096192 2697 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.091660 2762 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.127526 2762 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.125339 2697 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.084502 2766 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.096163 2776 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.090126 2696 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.097267 2772 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.131633 2696 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.133247 2772 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.134088 2696 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.108319 2763 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.110018 30363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45054 (request call id 2326) took 1214 ms. Trace:
I20260807 07:58:18.135172 30363 rpcz_store.cc:276] 0807 07:58:16.896017 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:16.896273 (+ 256us) service_pool.cc:224] Handling call
0807 07:58:18.098329 (+1202056us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b58001b0c98. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b83d2 00007fd6bb124219 00007fd6ba277640 00007fd6ba33febb 00007fd6ba33ff41 00007fd6ba301dd0 00007fd6ba2ec739 00007fd6ba2ec1e2 00007fd6b3831d34
0807 07:58:18.109259 (+ 10930us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:18.109504 (+ 245us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:18.109529 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:18.109586 (+ 57us) raft_consensus.cc:1645] Marking committed up to 4
0807 07:58:18.109624 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:18.109679 (+ 55us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:18.109805 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5713280}
I20260807 07:58:18.110152 2622 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.137431 2622 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:18.140003 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.140700 30369 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 11.
I20260807 07:58:18.110889 2676 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:18.141651 2676 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.096575 2769 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.146576 2769 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.147439 2622 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:58:18.115460 30518 debug-util.cc:398] Leaking SignalData structure 0x7b080016ec20 after lost signal to thread 30405
W20260807 07:58:18.149078 30518 debug-util.cc:398] Leaking SignalData structure 0x7b08000b42a0 after lost signal to thread 30521
I20260807 07:58:18.144737 2676 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.151542 2769 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.080648 30584 rpcz_store.cc:276] 0807 07:58:16.912819 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:18.079097 (+1166278us) service_pool.cc:224] Handling call
0807 07:58:18.079472 (+ 375us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:18.079831 (+ 359us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:18.079862 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:18.079909 (+ 47us) raft_consensus.cc:1645] Marking committed up to 5
0807 07:58:18.079947 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:18.080000 (+ 53us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:18.080093 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:58:18.129703 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.073153 2770 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:18.097018 2767 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.163302 30588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42218 (request call id 552) took 1249 ms. Trace:
I20260807 07:58:18.163820 30588 rpcz_store.cc:276] 0807 07:58:16.913329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:18.161989 (+1248660us) service_pool.cc:224] Handling call
0807 07:58:18.162453 (+ 464us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:18.162767 (+ 314us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:18.162797 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:18.162860 (+ 63us) raft_consensus.cc:1645] Marking committed up to 7
0807 07:58:18.162897 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:18.162956 (+ 59us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:18.163084 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:58:18.166332 2789 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.167049 2789 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.167585 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.169651 30590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42218 (request call id 550) took 1315 ms. Trace:
I20260807 07:58:18.170055 30590 rpcz_store.cc:276] 0807 07:58:16.910564 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:18.168488 (+1257924us) service_pool.cc:224] Handling call
0807 07:58:18.168838 (+ 350us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:18.169152 (+ 314us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:18.169176 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:18.169248 (+ 72us) raft_consensus.cc:1645] Marking committed up to 7
0807 07:58:18.169285 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:18.169341 (+ 56us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:18.169465 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:58:18.171339 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.172132 30363 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:18.173877 2767 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.175541 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.153561 2770 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.176801 2786 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.114600 30366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45046 (request call id 2515) took 1726 ms. Trace:
I20260807 07:58:18.151963 2782 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.177876 2782 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.178177 30366 rpcz_store.cc:276] 0807 07:58:16.387731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:18.113478 (+1725747us) service_pool.cc:224] Handling call
0807 07:58:18.113921 (+ 443us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:18.114203 (+ 282us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:18.114226 (+ 23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:18.114263 (+ 37us) raft_consensus.cc:1645] Marking committed up to 6
0807 07:58:18.114290 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:18.114346 (+ 56us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:18.114441 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:58:18.178038 2770 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.181989 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.185755 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:58:18.186271 30541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.260s user 0.010s sys 0.010s
W20260807 07:58:18.186617 30541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.260s user 0.010s sys 0.010s
I20260807 07:58:18.186868 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.188776 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.190197 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.190467 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.192085 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.192564 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.193126 2697 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.193840 2601 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.194517 2601 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.195535 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.196566 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.196694 2601 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:58:18.197990 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 1.2719e+06us
I20260807 07:58:18.199234 2601 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.199926 2601 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.200960 2793 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.201650 2793 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.202297 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.204295 2688 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.205065 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.204929 2688 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.207268 2688 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.205305 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.209914 2773 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.210660 2773 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.211285 2688 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.207479 2601 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.211953 2688 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.213243 2745 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.280368 2601 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.280568 2745 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.281026 2601 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.281890 2688 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.282847 2745 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.283280 2601 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.215817 2676 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.284364 2676 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.286478 2676 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.286960 2676 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.287444 2676 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.216288 2622 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.289388 2622 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
W20260807 07:58:18.291072 30518 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9360 after lost signal to thread 30627
W20260807 07:58:18.291400 30518 debug-util.cc:398] Leaking SignalData structure 0x7b0800324980 after lost signal to thread 30628
I20260807 07:58:18.291524 2622 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.216776 2766 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.292326 2766 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.294447 2766 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.218176 2773 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.218806 2611 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.295464 2611 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.297726 2611 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.219892 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.204882 2787 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.222500 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:58:18.298214 30518 debug-util.cc:398] Leaking SignalData structure 0x7b0800316700 after lost signal to thread 31418
I20260807 07:58:18.298561 2787 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.219944 2756 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.299682 2756 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.300028 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.300788 2787 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.301205 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.301782 2756 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.221709 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.302323 30487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:18.303054 30487 raft_consensus.cc:606] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:18.223368 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.221885 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.221678 2797 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.299108 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.307425 2797 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.309598 2797 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.309742 30223 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53640 (request call id 371) took 1833 ms. Trace:
I20260807 07:58:18.310189 30223 rpcz_store.cc:276] 0807 07:58:16.460224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:16.900773 (+440549us) service_pool.cc:224] Handling call
0807 07:58:18.293052 (+1392279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1324232,"reported_tablets":2}
I20260807 07:58:18.309670 2676 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.181231 2782 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.226666 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.227243 2701 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.229868 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.231639 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.314608 2701 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.232877 2802 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.234140 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:58:18.315912 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 56907.5us
I20260807 07:58:18.236371 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.241001 2770 consensus_queue.cc:1048] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:18.243719 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.244491 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.245441 2685 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:18.247727 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.248515 30221 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53660 (request call id 355) took 1819 ms. Trace:
I20260807 07:58:18.322634 30221 rpcz_store.cc:276] 0807 07:58:16.429065 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:16.429231 (+ 166us) service_pool.cc:224] Handling call
0807 07:58:18.248271 (+1819040us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":6400}
I20260807 07:58:18.250026 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.224753 30429 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:18.255072 2785 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.257828 2806 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:18.179350 2794 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.335325 2806 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.335915 2794 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.260838 2796 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.262290 2798 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.266000 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.270107 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.337741 2682 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:18.270761 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.270892 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.338775 2682 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.340648 2798 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.341760 30582 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:18.341759 2682 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.343240 2798 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.177452 2786 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.272845 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.274379 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.346781 2806 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.347605 2794 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.274968 2789 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.276221 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.276422 2784 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.277720 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.225742 2501 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.349634 2501 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.325997 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.351069 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.327160 2802 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.327977 2701 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.328927 30588 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:18.352407 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.352530 30588 raft_consensus.cc:606] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 8 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.352991 30584 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:58:18.328891 2685 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.353899 2802 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.354355 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.355087 2685 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.204234 2793 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:58:18.333002 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 108343us
I20260807 07:58:18.333356 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.356611 30429 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:18.333637 2758 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260807 07:58:18.334265 2785 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.365602 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.349282 2784 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.346833 2786 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.369205 2758 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.377676 2794 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.383315 2796 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.383884 2794 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.386152 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.386400 2796 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.386827 2782 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.387048 2393 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:18.387487 2393 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.387912 2393 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:18.388080 30369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe6785f099494896ae258fd098deadc1"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:18.388717 30369 raft_consensus.cc:606] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:18.390594 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 07:58:18.392138 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.393112 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:18.394235 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:18.396616 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.397708 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.399210 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.399658 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.400707 2794 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.387418 2782 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.402125 2701 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:58:18.402350 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 142746us
I20260807 07:58:18.402726 2701 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.403715 2782 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.385524 2758 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Advancing to term 12
I20260807 07:58:18.404940 2701 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.406749 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.407824 2812 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.408416 2812 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.408782 2501 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.409296 2785 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.409701 2697 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.410288 2697 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.410980 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.412428 2697 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.412489 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.413287 31385 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:58:18.414822 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.414956 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.415521 31378 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:58:18.415650 31384 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:58:18.415956 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.416539 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.417729 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.418301 31382 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 2.
I20260807 07:58:18.419085 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.419829 31377 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:58:18.420691 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.421787 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.422413 30490 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:58:18.424750 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.426335 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.402437 2784 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:18.429613 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 112173us
I20260807 07:58:18.431011 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.432461 2772 raft_consensus.cc:993] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:18.434062 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.435124 2685 raft_consensus.cc:1081] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:18.437714 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.439337 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.442342 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.442698 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.442407 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.445363 2785 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.446358 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.446709 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.449721 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.451026 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.459029 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.460086 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.461118 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.461822 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.465098 2804 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.465238 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.465718 2804 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.469527 2804 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.470139 30539 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:18.470935 2676 raft_consensus.cc:2804] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:58:18.471323 2676 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:18.471138 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.471860 2676 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:18.473740 2745 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.474273 2745 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.474568 2393 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.476246 2745 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.476611 2731 ts_tablet_manager.cc:933] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
I20260807 07:58:18.471374 2785 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.482092 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.483505 30369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:18.490031 2745 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.490373 2672 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.490633 2745 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.490923 2672 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.491672 2785 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.492619 2745 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.492780 2785 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.496385 2745 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:18.496959 2745 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.498982 2745 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.499280 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.530470 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.530174 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.530234 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.520143 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.542407 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.493404 2785 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.499993 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.543550 30369 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:18.556124 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.558809 2758 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.562987 30369 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:18.563699 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.564965 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.561966 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.566597 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.563014 31338 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.567678 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.568320 31376 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:58:18.568652 31338 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.610412 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.613701 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.613153 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.611590 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.577106 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.609575 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.620636 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.579146 2633 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.622241 30588 raft_consensus.cc:2410] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260807 07:58:18.622364 2633 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.492941 2672 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.570328 2782 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:18.571487 31338 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:18.625823 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.612090 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.612545 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:58:18.626628 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 55215.1us
I20260807 07:58:18.569320 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.630436 30369 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.554857 2812 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.638988 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.610167 2785 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.570590 2786 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:18.570303 31379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.569562 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.574954 2393 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.639176 31338 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:18.554816 2676 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:18.631160 2782 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:18.624694 2633 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.651937 31338 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:18.660153 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.660797 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.662266 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.660792 30364 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 7.
I20260807 07:58:18.663805 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.664456 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.667351 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.670092 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.672116 31379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.657653 2784 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:18.675833 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.676512 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.677418 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.678634 2676 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:18.680392 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.673658 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.684278 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.684906 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.687784 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.688515 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:18.696535 2758 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 12 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.816758 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:18.665897 2812 raft_consensus.cc:2749] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:18.766999 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.837730 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:18.750379 30541 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.837319 30367 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 5.
I20260807 07:58:18.701843 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:18.787592 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:18.841789 30480 raft_consensus.cc:3055] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:18.786979 30369 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:18.779991 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.813632 31338 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:18.828665 30579 raft_consensus.cc:1240] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 4. Current term is 5. Ops: []
I20260807 07:58:18.844487 30479 raft_consensus.cc:1240] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 11. Current term is 12. Ops: []
I20260807 07:58:18.844676 31338 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
W20260807 07:58:18.846745 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 96469.3us
I20260807 07:58:18.847476 31338 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.847702 30541 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.848623 31338 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.842139 30480 raft_consensus.cc:740] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:18.657192 2731 tablet_copy_client.cc:323] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.129:36407
I20260807 07:58:18.851652 31338 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.852903 31338 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.854424 30487 raft_consensus.cc:1240] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 6. Current term is 7. Ops: []
I20260807 07:58:18.759294 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.857440 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.849314 2786 raft_consensus.cc:2749] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:18.860173 30542 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
W20260807 07:58:18.843822 30429 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.519s (SENT) [suppressed 1 similar messages]
I20260807 07:58:18.861893 2686 consensus_queue.cc:1059] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260807 07:58:18.850904 2804 raft_consensus.cc:2749] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:18.851420 2808 raft_consensus.cc:2749] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:18.856334 2688 raft_consensus.cc:2749] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:18.864203 2808 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:18.864609 2808 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.864976 2808 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:18.855062 2782 raft_consensus.cc:2749] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:58:18.854321 2796 raft_consensus.cc:2749] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:18.700151 31379 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:58:18.856154 31338 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.794191 2772 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.757558 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.873593 31338 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.851037 2795 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:18.861161 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.856464 2745 raft_consensus.cc:2749] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:18.891276 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.894964 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:18.884343 2796 raft_consensus.cc:2749] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:18.904304 30323 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:58:18.898481 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 54683.4us
I20260807 07:58:18.909739 30323 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.887949 2795 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:18.915675 30323 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.913790 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:18.922627 31338 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
I20260807 07:58:18.900341 30480 consensus_queue.cc:260] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.889325 2772 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:18.929316 30480 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
W20260807 07:58:18.923019 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 67427.5us
I20260807 07:58:18.903208 2812 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:18.908475 2806 raft_consensus.cc:3055] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 11 LEADER]: Stepping down as leader of term 11
W20260807 07:58:18.938455 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 96797.6us
I20260807 07:58:18.912977 2697 raft_consensus.cc:2749] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:58:18.942803 30542 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:18.923017 2696 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:18.919912 2795 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Advancing to term 8
W20260807 07:58:18.939031 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 85273.9us
I20260807 07:58:18.949297 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.926167 2767 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:18.958194 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.958604 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.959497 2820 ts_tablet_manager.cc:933] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:18.963807 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.950507 2696 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:18.965598 2696 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:18.967007 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:18.938446 2806 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:19.008719 30320 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:19.010179 2695 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:18.994288 2798 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:19.012894 2798 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:19.013267 2798 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
W20260807 07:58:19.011732 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 54268.6us
I20260807 07:58:19.018757 30542 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.022812 30320 leader_election.cc:304] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:19.025513 30480 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:58:18.967763 2812 raft_consensus.cc:2804] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:19.033497 2772 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:19.035246 2808 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.036056 2795 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:19.037894 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 75058.8us
I20260807 07:58:19.038414 30542 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.041033 30542 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:19.041293 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:19.041970 30358 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:19.045312 30542 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.046434 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:19.047200 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:19.045996 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:19.049486 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:19.053889 30429 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:19.068756 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:19.069960 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:19.039338 2812 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:19.071288 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:58:19.049278 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 135665us
I20260807 07:58:19.048831 2676 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 07:58:19.072798 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 150232us
I20260807 07:58:19.019405 2822 consensus_queue.cc:1059] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260807 07:58:19.010933 2806 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:19.084877 31338 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.122282 31338 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:19.122404 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:19.123924 31338 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.055703 2785 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:19.044006 2811 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:58:19.071096 2821 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:58:19.041694 2783 raft_consensus.cc:2749] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:19.079134 2812 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:19.082702 2676 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:19.133665 31338 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.133240 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:19.140548 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:19.141491 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:58:19.142750 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:19.141465 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:19.126398 2794 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:19.128001 2782 raft_consensus.cc:2749] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:19.127784 2811 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:19.127763 2688 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260807 07:58:19.146207 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:19.142474 30320 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.128847 2821 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:19.147068 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:19.163302 2808 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:19.138269 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:19.165169 30320 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.145687 30542 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.166061 2795 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:19.166769 2763 raft_consensus.cc:2749] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:19.167579 31378 raft_consensus.cc:1217] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5] Dedup: 6.5->[]
I20260807 07:58:19.168308 2695 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260807 07:58:19.153275 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:19.145752 31338 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.139199 2676 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:19.156057 2832 consensus_queue.cc:1059] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:19.156678 2829 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:19.153928 2811 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:58:19.186448 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:19.190652 2794 raft_consensus.cc:3055] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:58:19.201148 2794 raft_consensus.cc:740] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:19.186468 2840 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:58:19.198488 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:19.197762 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:19.170567 2830 raft_consensus.cc:2749] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:19.169776 2821 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:19.199105 30317 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:58:19.205003 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 59317.8us
I20260807 07:58:19.185297 2806 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Advancing to term 12
I20260807 07:58:19.175566 2829 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:19.228363 30541 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.207165 2795 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:58:19.229610 2837 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:19.229868 2829 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:19.277827 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:19.276067 2845 raft_consensus.cc:2804] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election won for term 6
W20260807 07:58:19.285861 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 113999us
W20260807 07:58:19.281553 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 48859.4us
I20260807 07:58:19.287417 30541 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:58:19.301050 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 226297us
W20260807 07:58:19.230743 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 65648.8us
I20260807 07:58:19.302127 30320 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:19.307682 2676 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.312523 30430 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:19.312796 30541 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.314049 30541 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.315306 30430 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
W20260807 07:58:19.317492 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 175661us
I20260807 07:58:19.318192 2393 raft_consensus.cc:2749] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:58:19.318871 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:19.320495 2696 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.274044 2820 tablet_copy_client.cc:323] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
I20260807 07:58:19.308784 2811 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.336987 2696 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:19.327910 2812 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.340528 2812 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:19.309612 2837 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:19.352387 31383 raft_consensus.cc:1240] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:19.356451 30323 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
I20260807 07:58:19.359086 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:19.331885 30430 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:19.332608 2763 raft_consensus.cc:2749] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 07:58:19.332960 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 252916us
I20260807 07:58:19.335875 30320 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.315016 2686 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:19.322423 2798 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.366780 30320 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:19.367837 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:19.362282 30429 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:19.375339 30429 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:19.386047 30320 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.389292 30320 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.390959 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:19.330466 2845 raft_consensus.cc:697] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:19.361033 2772 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260807 07:58:19.397037 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 83049us
I20260807 07:58:19.399541 30541 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:58:19.400349 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 94240.7us
I20260807 07:58:19.370095 2696 raft_consensus.cc:2804] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:19.404749 31338 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:19.415023 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:19.420264 2845 consensus_queue.cc:237] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:19.428581 2842 raft_consensus.cc:2749] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:19.429939 2835 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:19.430634 2811 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:19.439007 2864 raft_consensus.cc:2749] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:19.442721 2824 raft_consensus.cc:2749] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:19.390695 2763 raft_consensus.cc:2749] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 07:58:19.444162 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 44710.6us
I20260807 07:58:19.445910 2843 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:19.447094 2672 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:19.449596 2798 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:19.286599 2794 consensus_queue.cc:260] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.440683 30585 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 12.
W20260807 07:58:19.457150 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 46030.4us
W20260807 07:58:19.467444 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 53908.9us
I20260807 07:58:19.469846 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:19.470980 2853 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:19.471653 2695 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:58:19.469291 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
W20260807 07:58:19.480316 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 103872us
I20260807 07:58:19.484897 2860 raft_consensus.cc:2749] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:19.487484 30429 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:19.408164 2696 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:19.456882 2795 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 07:58:19.497187 2846 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:19.415364 30386 tablet_copy_service.cc:140] P b1188d7d3a0b455894bc443d571f6a19: Received BeginTabletCopySession request for tablet 5cb72552d8da48b78c58110bb0c84f61 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:33338)
I20260807 07:58:19.496773 2682 raft_consensus.cc:2749] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:19.499351 30429 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:19.501518 30429 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:19.507256 30429 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:19.497509 31378 raft_consensus.cc:1240] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:19.493826 2696 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:19.495734 2806 consensus_queue.cc:1059] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260807 07:58:19.515899 2806 raft_consensus.cc:3055] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:19.516340 2806 raft_consensus.cc:740] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:19.519058 2865 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:19.519814 2865 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:19.520385 2865 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:19.513068 2772 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260807 07:58:19.511121 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 121918us
I20260807 07:58:19.525211 30429 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:19.532481 30502 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet f16f3d2817a34261bb25577fa0f9e2de from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
I20260807 07:58:19.554386 30502 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet f16f3d2817a34261bb25577fa0f9e2de from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-f16f3d2817a34261bb25577fa0f9e2de
I20260807 07:58:19.506760 2846 raft_consensus.cc:2749] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 07:58:19.567219 2798 raft_consensus.cc:993] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:19.566947 2829 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:19.567768 2798 raft_consensus.cc:1081] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 8 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:19.575124 2393 raft_consensus.cc:2749] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260807 07:58:19.576066 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 50929.1us
I20260807 07:58:19.578819 30429 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:19.579581 2758 raft_consensus.cc:2749] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 07:58:19.510857 30386 tablet_copy_service.cc:161] P b1188d7d3a0b455894bc443d571f6a19: Beginning new tablet copy session on tablet 5cb72552d8da48b78c58110bb0c84f61 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:33338: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-5cb72552d8da48b78c58110bb0c84f61
I20260807 07:58:19.536862 2837 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:19.542138 2821 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.581867 2821 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:19.578833 30223 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53660 (request call id 356) took 1002 ms. Trace:
I20260807 07:58:19.582926 30223 rpcz_store.cc:276] 0807 07:58:18.576552 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:18.576698 (+ 146us) service_pool.cc:224] Handling call
0807 07:58:18.697930 (+121232us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b5800032020. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b8a62 00007fd6bb184df9 00007fd6bb11dd56 00007fd6bb0ef248 00007fd6bb1ebbfe 00007fd6b96a54a4 00007fd6b96a5432 00007fd6b96a5361 00007fd6b96a52dc
0807 07:58:19.578761 (+880831us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181598,"reported_tablets":3,"spinlock_wait_cycles":88901504}
I20260807 07:58:19.542855 2785 raft_consensus.cc:3055] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:19.586103 2785 raft_consensus.cc:740] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:19.587008 2785 consensus_queue.cc:260] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:19.530592 2772 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:19.588474 2772 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:19.590412 2837 consensus_queue.cc:1059] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 07:58:19.591969 2857 raft_consensus.cc:3055] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:19.593745 2745 raft_consensus.cc:1064] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:58:19.594283 2676 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:19.595239 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:19.596232 2745 consensus_queue.cc:237] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.592396 2857 raft_consensus.cc:740] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:19.598507 2857 consensus_queue.cc:260] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.567970 2806 consensus_queue.cc:260] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.603673 2806 raft_consensus.cc:3060] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:19.604074 2785 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:19.604429 2794 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:19.610932 2865 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:19.616211 30502 tablet_copy_source_session.cc:215] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:58:19.616868 2829 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:19.620393 2696 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.624410 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:19.624764 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:19.625329 31377 raft_consensus.cc:2393] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 6: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:58:19.599488 2857 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:19.626682 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:19.627326 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:19.531432 30320 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:19.629575 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
W20260807 07:58:19.629871 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 98512us
I20260807 07:58:19.630122 2697 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:19.633285 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:19.633953 30482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:58:19.630657 30320 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.634554 30482 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:19.635437 2697 raft_consensus.cc:2749] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:19.635516 30482 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Advancing to term 10
W20260807 07:58:19.637223 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:19.638957 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:19.642031 30539 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.642812 2798 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 07:58:19.645147 30539 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.646271 2745 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260807 07:58:19.646752 30539 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.645850 30320 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.647377 2820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f16f3d2817a34261bb25577fa0f9e2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:58:19.648319 30539 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.648523 2783 raft_consensus.cc:2749] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:19.648729 2841 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 07:58:19.649531 2841 raft_consensus.cc:2749] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 07:58:19.637269 2865 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:19.650475 2696 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:19.651882 30320 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.653055 30320 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.653486 30539 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.654021 2697 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:19.654418 2867 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:58:19.654399 30320 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:19.655627 30429 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
W20260807 07:58:19.673966 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 94076us
I20260807 07:58:19.674738 30429 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:19.675494 2865 raft_consensus.cc:2749] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:58:19.676205 2865 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:19.678117 30429 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:19.656032 30320 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.657603 2697 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:19.679229 2829 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260807 07:58:19.658262 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:19.658066 30482 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:19.681766 30482 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:19.659605 31372 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEARNER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 07:58:19.653545 2696 raft_consensus.cc:2749] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:19.679247 30429 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:19.684303 2696 raft_consensus.cc:2749] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 07:58:19.684544 2829 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:19.685640 30320 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.686337 2696 raft_consensus.cc:2749] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:19.688369 30584 raft_consensus.cc:2468] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 6.
I20260807 07:58:19.690507 30586 raft_consensus.cc:1240] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 2. Current term is 3. Ops: []
I20260807 07:58:19.690841 30581 raft_consensus.cc:1240] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7. Ops: []
I20260807 07:58:19.662043 30477 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 07:58:19.692018 31338 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:19.666481 2772 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:19.694326 2772 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:19.695503 30369 raft_consensus.cc:1240] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7. Ops: []
I20260807 07:58:19.696732 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:19.693132 2787 raft_consensus.cc:2804] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:19.697077 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:19.699826 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:19.700238 2787 raft_consensus.cc:697] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:19.698143 2867 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:19.701649 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:19.702032 30581 raft_consensus.cc:1240] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:19.703512 2787 consensus_queue.cc:237] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.700454 30585 raft_consensus.cc:1240] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:19.706895 30320 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:19.707617 2696 raft_consensus.cc:2749] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:19.708470 30386 tablet_copy_source_session.cc:215] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:58:19.719930 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:19.720536 30366 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 10
I20260807 07:58:19.712255 30320 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.730945 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:19.731896 30584 raft_consensus.cc:3055] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:58:19.732237 30584 raft_consensus.cc:740] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:19.738078 2731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cb72552d8da48b78c58110bb0c84f61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:58:19.724398 2785 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260807 07:58:19.730739 2697 raft_consensus.cc:2749] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:19.747639 30541 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.751071 30366 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 10.
I20260807 07:58:19.747141 30584 consensus_queue.cc:260] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:19.756018 30541 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.756402 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:19.756765 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:19.757937 2785 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:19.764727 30590 raft_consensus.cc:2393] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 6: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:58:19.762020 30541 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.760820 2697 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:19.746730 2770 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:19.764816 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:19.765838 30541 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.770071 2798 raft_consensus.cc:2749] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 07:58:19.768182 2841 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:19.771433 2770 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:19.770291 2676 raft_consensus.cc:2749] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:19.769625 30541 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.776583 30541 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.778769 30541 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:19.779803 2676 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:19.779428 2697 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:19.796185 2697 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:19.799129 2685 consensus_queue.cc:1059] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:19.800341 2758 raft_consensus.cc:3055] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:19.800699 2758 raft_consensus.cc:740] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:19.801605 2758 consensus_queue.cc:260] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.803128 2758 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:19.805653 2856 raft_consensus.cc:993] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:19.806105 2856 raft_consensus.cc:1081] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:19.811249 30487 raft_consensus.cc:1240] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 8. Current term is 10. Ops: []
I20260807 07:58:19.814442 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:19.816259 30363 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 07:58:19.801664 30219 catalog_manager.cc:5697] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 5 to 6, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 6 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:19.833818 2785 raft_consensus.cc:2749] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:19.838339 30317 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:58:19.843914 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 52930.5us
I20260807 07:58:19.773658 2770 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:19.853078 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 54155.5us
W20260807 07:58:19.852124 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 43986.4us
I20260807 07:58:19.784272 2798 raft_consensus.cc:2749] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:19.871680 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:19.862180 30482 raft_consensus.cc:1240] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 8. Current term is 9. Ops: []
I20260807 07:58:19.867731 30480 raft_consensus.cc:1240] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:19.869495 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:19.857915 2845 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260807 07:58:19.870685 2876 log.cc:927] Time spent T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.077s user 0.001s sys 0.000s
I20260807 07:58:19.879756 30489 raft_consensus.cc:2393] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 7: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:19.854368 30429 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:19.883596 2829 raft_consensus.cc:2804] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 07:58:19.899111 30429 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:19.900492 30429 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:19.902346 2619 consensus_queue.cc:1059] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 07:58:19.903949 2619 raft_consensus.cc:3055] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:19.904438 2619 raft_consensus.cc:740] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:19.905829 2829 raft_consensus.cc:697] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 10 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:19.905933 2619 consensus_queue.cc:260] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.900566 2501 consensus_queue.cc:1059] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:19.909679 2851 raft_consensus.cc:3055] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Stepping down as leader of term 2
I20260807 07:58:19.910187 2851 raft_consensus.cc:740] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:19.907441 2829 consensus_queue.cc:237] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:19.911064 2619 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:19.915751 2851 consensus_queue.cc:260] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.917469 2760 consensus_queue.cc:1059] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 07:58:19.902245 2865 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 07:58:19.861341 2820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59392 (request call id 376) took 1092 ms. Trace:
I20260807 07:58:19.924551 2851 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:58:19.941121 30541 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:19.942231 2857 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:19.946202 2501 raft_consensus.cc:3055] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:19.946586 2501 raft_consensus.cc:740] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:19.938742 2845 consensus_queue.cc:1059] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260807 07:58:19.948428 2867 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:19.949608 2501 consensus_queue.cc:260] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:19.950100 30429 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:19.950992 2828 raft_consensus.cc:2749] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 07:58:19.951741 2845 raft_consensus.cc:3055] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:19.953249 30320 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:19.956377 2697 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 07:58:19.952152 2845 raft_consensus.cc:740] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:19.932714 2772 consensus_queue.cc:1059] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260807 07:58:19.950973 2501 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:19.963569 30588 raft_consensus.cc:1240] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:58:19.947575 2853 consensus_queue.cc:1059] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260807 07:58:19.979132 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:19.983523 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:19.984193 30585 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:19.986637 30584 raft_consensus.cc:3060] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 10
I20260807 07:58:19.994948 30588 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe6785f099494896ae258fd098deadc1"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:58:19.995982 30320 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:19.997463 30588 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:19.997869 30588 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:19.998559 2682 consensus_queue.cc:1059] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:19.999478 2846 raft_consensus.cc:3055] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:58:19.999830 2846 raft_consensus.cc:740] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:20.000187 30320 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:20.000640 2846 consensus_queue.cc:260] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:20.001473 2783 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:20.002526 2767 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:20.018397 30584 raft_consensus.cc:2468] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 10.
I20260807 07:58:19.976410 2845 consensus_queue.cc:260] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:20.024065 2845 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:20.016616 2767 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:20.032750 2767 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:20.000697 2760 raft_consensus.cc:3055] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:20.033864 2760 raft_consensus.cc:740] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:20.023134 30482 raft_consensus.cc:2955] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:20.012881 30223 catalog_manager.cc:5697] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 5 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:20.052937 2846 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:19.931905 2820 rpcz_store.cc:276] 0807 07:58:18.746642 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:18.748374 (+ 1732us) service_pool.cc:224] Handling call
0807 07:58:18.959816 (+211442us) ts_tablet_manager.cc:934] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
0807 07:58:19.441138 (+481322us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b4c002eec00. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b35bffc0 00007fd6b35d0fa9 00007fd6b35d168f 00007fd6b3594e7b 00007fd6b35c34dc 00007fd6b35c3a01 00007fd6b35c3d08 00007fd6b937d40b 00007fd6ba2a3b4b 00007fd6ba29de18 00007fd6ba29d215
0807 07:58:19.645269 (+204131us) tablet_copy_client.cc:368] Tablet copy session begun
0807 07:58:19.666544 (+ 21275us) tablet_metadata.cc:665] Metadata flushed
0807 07:58:19.666672 (+ 128us) tablet_copy_client.cc:497] Wrote new tablet metadata
0807 07:58:19.834228 (+167556us) tablet_copy_client.cc:418] Wrote new consensus metadata
0807 07:58:19.835633 (+ 1405us) tablet_replica.cc:206] Creating consensus instance
0807 07:58:19.836075 (+ 442us) ts_tablet_manager.cc:989] Replica registered.
0807 07:58:19.837877 (+ 1802us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":112589,"spinlock_wait_cycles":4081920,"tablet-copy.queue_time_us":189581,"thread_start_us":322925,"threads_started":2}
I20260807 07:58:20.052330 2760 consensus_queue.cc:260] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:20.114180 2760 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:20.123847 2731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59320 (request call id 530) took 1648 ms. Trace:
I20260807 07:58:20.124285 2731 rpcz_store.cc:276] 0807 07:58:18.475650 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:18.475768 (+ 118us) service_pool.cc:224] Handling call
0807 07:58:18.476965 (+ 1197us) ts_tablet_manager.cc:934] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407)
0807 07:58:19.710753 (+1233788us) tablet_copy_client.cc:368] Tablet copy session begun
0807 07:58:19.896246 (+185493us) tablet_metadata.cc:665] Metadata flushed
0807 07:58:19.896465 (+ 219us) tablet_copy_client.cc:497] Wrote new tablet metadata
0807 07:58:20.123105 (+226640us) tablet_copy_client.cc:418] Wrote new consensus metadata
0807 07:58:20.123407 (+ 302us) tablet_replica.cc:206] Creating consensus instance
0807 07:58:20.123727 (+ 320us) ts_tablet_manager.cc:989] Replica registered.
0807 07:58:20.123786 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":14959,"tablet-copy.queue_time_us":168,"thread_start_us":153857,"threads_started":1}
I20260807 07:58:20.036157 2798 raft_consensus.cc:2955] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:58:20.150857 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:20.151010 30588 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:20.156975 30590 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:20.083443 2869 raft_consensus.cc:3055] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:58:20.161566 30584 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:20.166910 30588 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:20.168443 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:20.169001 30363 raft_consensus.cc:3055] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:58:20.148804 2820 tablet_copy_client.cc:806] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:58:20.170859 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:20.169252 30363 raft_consensus.cc:740] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:20.171873 30482 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:20.172544 30363 consensus_queue.cc:260] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:20.164101 2866 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 10 LEADER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 07:58:20.179211 30482 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 9.
I20260807 07:58:20.163950 2869 raft_consensus.cc:740] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:20.190331 2820 tablet_copy_client.cc:670] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:58:20.190826 2869 consensus_queue.cc:260] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:20.192329 2869 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:20.195631 31372 raft_consensus.cc:2955] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:20.169493 2794 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260807 07:58:20.171156 2731 tablet_copy_client.cc:806] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:58:20.204696 30590 raft_consensus.cc:1275] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:58:20.229825 2820 tablet_copy_client.cc:538] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:58:20.237362 30369 raft_consensus.cc:1275] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:20.255450 2794 consensus_queue.cc:1048] T 14880a591ef44360b5046f67cab3d4ad P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:20.265619 30539 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:20.270193 2867 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election won for term 9
I20260807 07:58:20.270692 2867 raft_consensus.cc:697] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:20.271545 2867 consensus_queue.cc:237] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:20.204766 30482 raft_consensus.cc:1275] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:58:20.218017 30363 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:20.226279 2731 tablet_copy_client.cc:670] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
W20260807 07:58:20.282366 2879 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4: Append to log took a long time: real 0.219s user 0.000s sys 0.001s
I20260807 07:58:20.284309 2767 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:20.285590 2697 consensus_queue.cc:1048] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:58:20.286823 2767 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:20.291343 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 123530us
I20260807 07:58:20.294476 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:20.295261 30482 raft_consensus.cc:2393] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 7: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:20.296881 30363 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 9.
I20260807 07:58:20.298949 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:20.329309 30586 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:20.351541 30588 raft_consensus.cc:1240] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 8. Current term is 9. Ops: []
I20260807 07:58:20.350756 30320 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:20.355662 2731 tablet_copy_client.cc:538] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 07:58:20.359581 2820 tablet_bootstrap.cc:492] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:58:20.317338 2845 consensus_queue.cc:1048] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260807 07:58:20.375914 2869 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:20.481077 2869 raft_consensus.cc:697] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:20.521360 2869 consensus_queue.cc:237] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:20.526468 2894 log.cc:927] Time spent T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260807 07:58:20.530668 2731 tablet_bootstrap.cc:492] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap starting.
I20260807 07:58:20.515864 30372 raft_consensus.cc:2955] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:20.574319 30369 raft_consensus.cc:1275] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260807 07:58:20.583602 2846 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:20.584259 2846 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:20.587165 2846 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:20.588604 2760 consensus_queue.cc:1048] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:20.592424 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:20.593137 31372 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:58:20.595000 30430 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:20.611018 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:20.611925 30590 raft_consensus.cc:2393] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 5: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:20.615145 2501 raft_consensus.cc:2804] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260807 07:58:20.622843 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 146056us
W20260807 07:58:20.640939 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 143631us
I20260807 07:58:20.623812 2501 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:20.659906 2501 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:20.674926 30585 raft_consensus.cc:1275] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260807 07:58:20.685475 2866 consensus_queue.cc:1048] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:58:20.690407 2501 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:20.718961 2501 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:20.721323 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:20.722205 30588 raft_consensus.cc:2393] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 5: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:20.725299 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:20.738813 2745 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:20.747120 2745 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:20.752943 30480 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260807 07:58:20.749053 31372 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:58:20.759553 30430 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:58:20.760805 2846 raft_consensus.cc:2804] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:58:20.762310 2846 raft_consensus.cc:697] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:20.764732 2846 consensus_queue.cc:237] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:20.767143 2745 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:20.768267 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:20.769150 31372 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:58:20.772449 2887 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260807 07:58:20.775053 30542 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:20.777241 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:20.782392 2745 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:20.798517 2745 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:20.822137 2745 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:20.850095 30219 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40988 (request call id 184) took 1058 ms. Trace:
I20260807 07:58:20.855245 30358 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260807 07:58:20.873464 2911 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:20.874593 30222 catalog_manager.cc:5697] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: config changed from index 5 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:20.880733 30222 catalog_manager.cc:5697] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 8 to 10, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 10 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:20.890399 2745 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:20.892932 2745 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:20.894057 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:20.894678 31372 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:20.899590 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:20.901687 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:20.850746 30219 rpcz_store.cc:276] 0807 07:58:19.791386 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:19.791549 (+ 163us) service_pool.cc:224] Handling call
0807 07:58:20.850025 (+1058476us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:58:19.863843 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:58:19.865154 (+ 1311us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:58:19.865254 (+ 100us) write_op.cc:435] Acquired schema lock
0807 07:58:19.865344 (+ 90us) tablet.cc:662] Decoding operations
0807 07:58:19.876418 (+ 11074us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:58:19.876688 (+ 270us) write_op.cc:641] Partition lock acquired for write op
0807 07:58:19.876782 (+ 94us) tablet.cc:685] Acquiring locks for 1 operations
0807 07:58:19.877307 (+ 525us) tablet.cc:701] Row locks acquired
0807 07:58:19.877412 (+ 105us) write_op.cc:260] PREPARE: finished
0807 07:58:19.877749 (+ 337us) write_op.cc:270] Start()
0807 07:58:19.877938 (+ 189us) write_op.cc:276] Timestamp: P: 1786089499877621 usec, L: 0
0807 07:58:19.878004 (+ 66us) op_driver.cc:348] REPLICATION: starting
0807 07:58:19.879296 (+ 1292us) log.cc:844] Serialized 536 byte log entry
0807 07:58:20.524056 (+644760us) op_driver.cc:464] REPLICATION: finished
0807 07:58:20.671968 (+147912us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b440002250c. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b2116855 00007fd6b2117272 00007fd6b4ea13bb 00007fd6b4e9cc9f 00007fd6b21d2a5c 00007fd6bb07afc9 00007fd6b21eefdb 00007fd6b21ed2db 00007fd6b21ef542 00007fd6b8d4c8d0
0807 07:58:20.778655 (+106687us) write_op.cc:301] APPLY: starting
0807 07:58:20.778802 (+ 147us) tablet.cc:1367] starting BulkCheckPresence
0807 07:58:20.779050 (+ 248us) tablet.cc:1370] finished BulkCheckPresence
0807 07:58:20.779120 (+ 70us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:58:20.779695 (+ 575us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:58:20.780455 (+ 760us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 07:58:20.780588 (+ 133us) write_op.cc:312] APPLY: finished
0807 07:58:20.781154 (+ 566us) log.cc:844] Serialized 23 byte log entry
0807 07:58:20.784171 (+ 3017us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:20.786545 (+ 2374us) write_op.cc:454] Released schema lock
0807 07:58:20.793746 (+ 7201us) write_op.cc:341] FINISH: Updating metrics
0807 07:58:20.834639 (+ 40893us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:20.834672 (+ 33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":254209,"apply.run_cpu_time_us":3730,"apply.run_wall_time_us":56021,"num_ops":1,"prepare.queue_time_us":38348,"prepare.run_cpu_time_us":29219,"prepare.run_wall_time_us":118861,"raft.queue_time_us":533200,"raft.run_cpu_time_us":48467,"raft.run_wall_time_us":328165,"replication_time_us":638255,"spinlock_wait_cycles":24557952,"thread_start_us":485381,"threads_started":4,"wal-append.queue_time_us":163094}]]}
I20260807 07:58:20.932358 2855 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:20.938601 2855 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:20.942602 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:20.943252 30477 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 3.
I20260807 07:58:20.933516 2911 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:20.945197 31336 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:20.946151 2802 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 07:58:20.946587 2802 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:20.947106 2802 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 2 FOLLOWER]: Advancing to term 3
I20260807 07:58:20.944980 31372 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 9.
I20260807 07:58:20.944952 2911 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:20.961292 2855 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:20.964052 2911 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:20.965706 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:20.966444 30586 raft_consensus.cc:2393] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:20.968726 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:20.969774 31377 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:58:20.970585 30586 raft_consensus.cc:1275] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:20.971451 30542 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:20.973179 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:20.977617 2697 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:20.979424 2676 raft_consensus.cc:2804] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:20.980966 2676 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:20.981462 2676 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:20.986065 30482 raft_consensus.cc:1275] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:20.994834 30542 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:20.997313 2911 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election won for term 9
I20260807 07:58:20.997922 2911 raft_consensus.cc:697] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:20.998769 2911 consensus_queue.cc:237] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:20.994649 2868 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260807 07:58:21.046586 30482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:21.047194 30482 raft_consensus.cc:606] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:21.047585 30482 raft_consensus.cc:614] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260807 07:58:21.051236 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 151ecad19f9e4079986c980524b2f3c0 (from ef1ca7acf52a438f89f14707e9e06818 to f831a53ec51d452398015797d543164e) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:58:21.080868 2697 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:21.083854 30372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:21.084306 30372 raft_consensus.cc:606] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:21.084512 30372 raft_consensus.cc:614] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 07:58:21.087957 2820 tablet_bootstrap.cc:492] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:58:21.082825 2697 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:21.090570 2855 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:21.095613 2855 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.097077 2697 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.097715 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:21.098214 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:21.098470 30488 raft_consensus.cc:2393] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 12: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:21.100185 2731 tablet_bootstrap.cc:492] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=1 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 07:58:21.101312 2731 tablet_bootstrap.cc:492] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:58:21.098821 30588 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 12.
I20260807 07:58:21.102228 2731 ts_tablet_manager.cc:1403] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.572s user 0.029s sys 0.017s
I20260807 07:58:21.102974 30320 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:21.103303 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:58:21.094775 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 5cb72552d8da48b78c58110bb0c84f61 (from b1188d7d3a0b455894bc443d571f6a19 to f831a53ec51d452398015797d543164e) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
I20260807 07:58:21.104426 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:21.103920 30488 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 8.
I20260807 07:58:21.105929 2855 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.106105 31336 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:21.106101 2901 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260807 07:58:21.107666 2901 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:21.108037 2901 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Advancing to term 12
I20260807 07:58:21.109040 2731 raft_consensus.cc:359] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:21.118257 2731 raft_consensus.cc:740] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:58:21.116814 30372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:21.119115 30372 raft_consensus.cc:606] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:21.111161 30588 raft_consensus.cc:2393] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 8: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:21.122090 2855 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:21.122509 2855 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:21.122874 2855 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:21.127928 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260807 07:58:21.120431 2731 consensus_queue.cc:260] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:21.135672 30223 catalog_manager.cc:5697] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 8 to 9, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 9 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:58:21.138051 2731 ts_tablet_manager.cc:1434] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.035s user 0.003s sys 0.005s
I20260807 07:58:21.139851 2901 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:21.141482 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:21.142298 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:21.145032 2820 tablet_bootstrap.cc:492] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Bootstrap complete.
I20260807 07:58:21.147848 30386 tablet_copy_service.cc:342] P b1188d7d3a0b455894bc443d571f6a19: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-5cb72552d8da48b78c58110bb0c84f61 received from {username='slave'} at 127.0.0.1:33338
I20260807 07:58:21.178536 30386 tablet_copy_service.cc:434] P b1188d7d3a0b455894bc443d571f6a19: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-5cb72552d8da48b78c58110bb0c84f61 on tablet 5cb72552d8da48b78c58110bb0c84f61 with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:21.178875 2820 ts_tablet_manager.cc:1403] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent bootstrapping tablet: real 0.820s user 0.033s sys 0.032s
I20260807 07:58:21.081641 2802 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.148576 2855 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.181535 2855 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.159703 2912 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:21.182313 2912 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.183398 2802 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.164752 2758 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:21.166576 2867 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:21.287437 2758 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.287571 2867 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.289494 2770 raft_consensus.cc:993] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:21.289808 2867 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:21.166886 2676 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.290236 2767 raft_consensus.cc:1081] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:21.291705 2676 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:21.167778 2501 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:21.173955 30221 catalog_manager.cc:5697] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 6 to 7, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:21.292119 2758 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:21.292857 30477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:58:21.293426 30477 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:21.293745 30477 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:21.294967 2802 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:21.295473 2802 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.298038 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:21.298324 2899 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:21.298909 30489 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 5.
I20260807 07:58:21.298954 2899 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.300062 31336 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:21.301548 2794 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:58:21.301985 2794 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:21.302348 2794 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:21.303246 30477 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:21.305264 30477 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.267475 2901 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.235349 2697 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:58:21.265578 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 66092.6us
I20260807 07:58:21.271936 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:21.322141 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:21.322773 31376 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:21.324692 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:21.272140 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:21.325822 30482 raft_consensus.cc:2393] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 12: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:21.272923 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:21.273000 2911 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:21.275374 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:21.276153 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:21.326804 2911 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:21.276798 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:21.328017 30590 raft_consensus.cc:2393] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 7: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:21.277474 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:21.329092 30586 raft_consensus.cc:2393] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 3: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:21.327484 30585 raft_consensus.cc:2393] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 8: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:21.331828 2911 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:21.320318 2697 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:21.333458 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:21.334072 30487 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:58:21.336694 30585 raft_consensus.cc:1240] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:21.267571 2912 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.261353 2820 raft_consensus.cc:359] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:21.281174 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:21.203305 30588 consensus_queue.cc:237] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.301174 2899 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:21.312075 30219 catalog_manager.cc:5697] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 4 to 5, leader changed from 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:21.299547 2501 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.315739 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:21.346791 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:21.347584 30480 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 7.
I20260807 07:58:21.348284 2501 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:21.315923 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:21.325215 30584 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:21.347600 30590 raft_consensus.cc:2393] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 5: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:21.298303 2802 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.338541 2820 raft_consensus.cc:740] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Initialized, Role: LEARNER
I20260807 07:58:21.354478 2820 consensus_queue.cc:260] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:21.346731 31377 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:21.353288 30581 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 12.
I20260807 07:58:21.363983 30584 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:21.365270 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:21.366083 30363 raft_consensus.cc:3055] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:21.366365 30363 raft_consensus.cc:740] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:21.367017 30363 consensus_queue.cc:260] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:21.365420 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:21.368249 30358 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
W20260807 07:58:21.364925 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 44321.9us
I20260807 07:58:21.370730 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:21.378996 30476 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 8.
I20260807 07:58:21.389814 31336 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:58:21.371281 30358 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 9.
I20260807 07:58:21.389269 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:21.391831 30372 raft_consensus.cc:2393] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 7: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:58:21.376705 30488 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 3.
W20260807 07:58:21.389343 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 50094.1us
I20260807 07:58:21.393568 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:21.394707 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:21.395301 30480 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 7.
I20260807 07:58:21.396651 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
W20260807 07:58:21.397763 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 52428.2us
I20260807 07:58:21.397230 31383 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:21.400868 30363 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:21.393430 2869 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:21.414618 2944 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:21.414954 31336 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:58:21.415138 2944 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:21.418263 2697 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.404211 2794 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.422767 30541 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:21.423501 2912 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:58:21.423978 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 55521us
I20260807 07:58:21.424314 2798 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:21.425002 2869 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.446729 2798 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.424691 30320 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:21.450011 2697 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 12 FOLLOWER]: Leader election won for term 12
I20260807 07:58:21.450641 2697 raft_consensus.cc:697] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 12 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:21.400714 2846 consensus_queue.cc:1059] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260807 07:58:21.452160 2846 raft_consensus.cc:3055] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:21.452702 2846 raft_consensus.cc:740] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:21.453815 2846 consensus_queue.cc:260] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.454298 2794 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.430403 30363 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:21.439180 2940 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:21.455144 31372 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:58:21.424015 31377 raft_consensus.cc:2468] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:58:21.455767 2940 raft_consensus.cc:697] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:21.456750 2940 consensus_queue.cc:237] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.457692 2867 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:21.458105 2867 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:21.458449 2867 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:21.459167 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:21.459794 30588 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:58:21.460278 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:21.461129 2912 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.461597 2798 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:21.462600 31376 raft_consensus.cc:1240] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:21.463150 2912 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.464588 2869 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:21.451745 2697 consensus_queue.cc:237] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:21.442536 2820 ts_tablet_manager.cc:1434] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent starting tablet: real 0.263s user 0.005s sys 0.005s
I20260807 07:58:21.465756 30223 catalog_manager.cc:5697] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:21.455009 2846 raft_consensus.cc:3060] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:21.468415 30320 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:21.474128 30363 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260807 07:58:21.476464 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 78132.4us
I20260807 07:58:21.480252 30542 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:21.482203 31372 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:21.484102 31372 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260807 07:58:21.487622 2886 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:21.478821 2853 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:21.488641 2853 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:21.488983 2853 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:21.491843 30542 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:21.492667 2785 raft_consensus.cc:2804] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:21.493187 2785 raft_consensus.cc:697] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:21.494079 2785 consensus_queue.cc:237] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.494694 2798 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:21.495123 2798 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:21.495446 2798 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:21.496141 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:21.497310 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:21.498112 30584 raft_consensus.cc:2393] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 8: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:21.467465 2944 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Advancing to term 7
W20260807 07:58:21.474838 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 75556.3us
I20260807 07:58:21.506609 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:21.507251 30584 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:21.514302 2867 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:21.518590 2886 raft_consensus.cc:2955] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:21.520624 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:21.521592 31372 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:58:21.523350 2676 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:21.529951 2676 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 07:58:21.536561 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:21.540122 30363 raft_consensus.cc:2955] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:21.541615 30542 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:21.542443 2887 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:21.542857 2887 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:21.543296 2887 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
W20260807 07:58:21.550974 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 136110us
I20260807 07:58:21.551749 31336 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:58:21.552836 30372 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 9.
I20260807 07:58:21.554685 30541 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:21.562337 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:21.562935 30480 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:58:21.563858 2950 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader election won for term 3
I20260807 07:58:21.563980 31336 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:21.564680 2950 raft_consensus.cc:697] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:21.565653 2946 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:21.566049 2946 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:21.566576 2946 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:21.566000 2950 consensus_queue.cc:237] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.571161 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:21.571784 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:21.582355 2867 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:21.585089 30502 tablet_copy_service.cc:342] P ef1ca7acf52a438f89f14707e9e06818: Request end of tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-f16f3d2817a34261bb25577fa0f9e2de received from {username='slave'} at 127.0.0.1:34358
I20260807 07:58:21.585932 30502 tablet_copy_service.cc:434] P ef1ca7acf52a438f89f14707e9e06818: ending tablet copy session 6bd20e9c0d3e4ace86fc1f55ab9425fa-f16f3d2817a34261bb25577fa0f9e2de on tablet f16f3d2817a34261bb25577fa0f9e2de with peer 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:21.556814 2945 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:21.591778 2945 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.595703 30476 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 5.
I20260807 07:58:21.612953 30480 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 8.
I20260807 07:58:21.613674 30429 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:21.614691 30429 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:21.570209 2911 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election won for term 9
I20260807 07:58:21.595552 2945 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:21.649672 2887 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.653517 2887 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:21.656297 2798 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.657562 30588 raft_consensus.cc:2368] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 5. Current term is 6.
I20260807 07:58:21.658382 2846 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:21.659042 2846 raft_consensus.cc:697] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:21.660179 2846 consensus_queue.cc:237] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:21.637521 2911 raft_consensus.cc:697] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:21.658396 31379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:21.663802 2798 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:21.641567 2758 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:21.549736 2853 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:21.670570 30430 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:58:21.684213 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 69694.9us
I20260807 07:58:21.697902 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:21.701699 30480 raft_consensus.cc:2393] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 9: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:21.702584 30363 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 9
W20260807 07:58:21.707427 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 69834.1us
I20260807 07:58:21.684855 31379 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Advancing to term 9
I20260807 07:58:21.677676 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:21.710870 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:21.713742 30480 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:58:21.714188 31338 leader_election.cc:400] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 5. Current term is 6.
I20260807 07:58:21.714505 31338 leader_election.cc:403] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260807 07:58:21.682112 2758 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:21.656810 2944 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.724666 2758 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:21.723651 31378 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:21.734181 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:21.735117 30476 raft_consensus.cc:2393] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 9: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:21.737119 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:21.737708 30487 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:21.738528 2911 consensus_queue.cc:237] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:21.734287 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 61ca595a07a748bb83b4aa11cb066270 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:58:21.741570 2943 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:21.742384 2943 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:21.742892 2943 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:21.745046 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:21.745748 30480 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:21.748682 2853 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.751552 2944 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.742760 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:21.756115 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:21.758813 31376 raft_consensus.cc:1217] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7] Dedup: 8.7->[]
I20260807 07:58:21.759163 31379 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 9.
I20260807 07:58:21.760443 30542 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:21.761307 2909 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election won for term 9
I20260807 07:58:21.761927 2909 raft_consensus.cc:697] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:21.762809 2909 consensus_queue.cc:237] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.768837 30487 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 9.
I20260807 07:58:21.723140 30363 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260807 07:58:21.686848 2946 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.774839 31377 raft_consensus.cc:2955] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:58:21.777154 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 68400.2us
I20260807 07:58:21.774174 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:21.778565 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:21.779258 30581 raft_consensus.cc:2393] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 7: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:21.778697 30588 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 7
I20260807 07:58:21.774436 31378 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
W20260807 07:58:21.784041 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 145896us
W20260807 07:58:21.779593 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 145570us
I20260807 07:58:21.788756 30480 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:58:21.789984 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:21.790743 30369 raft_consensus.cc:2393] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 7: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:58:21.795166 30323 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:21.796274 2697 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:21.802637 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:21.803282 30480 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:21.804522 30588 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:21.811892 30320 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:21.817049 30480 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:21.820363 2945 raft_consensus.cc:476] T 8918375a62fa49ce8a2a4e5ef0f403df P ef1ca7acf52a438f89f14707e9e06818 [term 10 LEADER]: Not starting pre-election -- already a leader
I20260807 07:58:21.787454 2946 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:21.798197 2794 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 5. Current term is 6.
I20260807 07:58:21.835702 30542 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:21.762717 2758 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.855050 2758 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:21.855712 2887 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:21.856236 2887 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.864387 2957 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:21.832758 2806 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260807 07:58:21.761159 30219 catalog_manager.cc:5697] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 5 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:21.833155 2676 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:21.866654 2887 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:21.837492 2948 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:21.868312 2867 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:21.874480 2869 raft_consensus.cc:476] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260807 07:58:21.876274 30223 catalog_manager.cc:5697] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 11 to 12, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 12 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
W20260807 07:58:21.879783 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 192502us
I20260807 07:58:21.879105 31379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:21.884828 2867 raft_consensus.cc:697] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:21.886181 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:21.886891 2867 consensus_queue.cc:237] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.889423 31379 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:21.881723 2676 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.884182 2948 raft_consensus.cc:697] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:21.913067 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:21.914435 30369 raft_consensus.cc:3060] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:21.883543 2957 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:21.921844 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:58:21.925179 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 102378us
I20260807 07:58:21.905740 2676 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:21.933424 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 302454us
I20260807 07:58:21.925895 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:21.943338 30369 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:21.958199 2957 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:21.959018 2948 consensus_queue.cc:237] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:21.967891 2943 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:21.988901 30588 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260807 07:58:21.992738 31379 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:22.001433 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:22.001926 31336 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:58:22.002131 30487 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:58:22.003371 2794 raft_consensus.cc:2764] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260807 07:58:22.004951 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:22.005692 30488 raft_consensus.cc:2368] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 7. Current term is 8.
I20260807 07:58:22.006589 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:22.007266 30476 raft_consensus.cc:2368] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 7. Current term is 8.
I20260807 07:58:22.008025 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:22.008612 30480 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:58:22.015090 30581 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260807 07:58:22.015628 30539 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:22.016456 2676 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:22.016887 2676 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:22.017925 2676 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:22.024466 31336 leader_election.cc:400] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 7. Current term is 8.
I20260807 07:58:22.024830 31336 leader_election.cc:403] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260807 07:58:22.028960 2950 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 7. Current term is 8.
I20260807 07:58:22.017083 30539 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:22.035885 2785 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:58:22.036360 2785 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:22.036787 2785 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:22.039889 31336 leader_election.cc:400] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 7. Current term is 8.
I20260807 07:58:22.040217 31336 leader_election.cc:403] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260807 07:58:22.045943 2794 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:22.047240 30430 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:22.048223 2957 raft_consensus.cc:2804] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:22.048882 2957 raft_consensus.cc:697] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:22.050246 2957 consensus_queue.cc:237] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:22.052336 30480 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260807 07:58:22.058920 2943 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:22.060051 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:22.060806 30480 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260807 07:58:22.099007 2963 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 07:58:22.062801 2794 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 7. Current term is 8.
I20260807 07:58:22.064038 2785 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:22.066512 2676 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:22.107672 2676 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:22.104985 2785 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:22.066359 2869 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260807 07:58:22.094817 2758 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:22.111094 2758 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:22.113974 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
W20260807 07:58:22.095512 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 45373.8us
I20260807 07:58:22.115605 30223 catalog_manager.cc:5697] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 5 to 6, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:22.117311 2946 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 07:58:22.123051 31379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:22.123415 30487 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260807 07:58:22.124764 2770 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260807 07:58:22.125110 2794 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:22.129266 2758 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:22.132874 31378 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:22.166682 30430 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:22.167740 2943 raft_consensus.cc:2804] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:22.170042 2943 raft_consensus.cc:697] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:22.178781 2943 consensus_queue.cc:237] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:22.175659 30223 catalog_manager.cc:5697] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 7 to 8, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 8 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:22.196555 30223 catalog_manager.cc:5697] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 2 to 3, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 3 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:22.208664 30223 catalog_manager.cc:5697] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 6 to 7, VOTER ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) evicted. New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:22.227244 30372 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260807 07:58:22.230522 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:22.228545 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:22.238435 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:22.256278 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:22.259265 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:22.276717 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:22.277493 30369 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 9.
I20260807 07:58:22.278895 30586 raft_consensus.cc:1240] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260807 07:58:22.286633 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:22.287376 30579 raft_consensus.cc:3060] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:22.290418 30539 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:22.293546 30539 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:22.273196 2806 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260807 07:58:22.310019 2978 log.cc:927] Time spent T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260807 07:58:22.303857 2911 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:58:22.304034 2950 consensus_queue.cc:1059] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260807 07:58:22.321626 2950 raft_consensus.cc:3055] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:58:22.322192 2950 raft_consensus.cc:740] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:22.323586 2950 consensus_queue.cc:260] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:22.298197 2886 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 07:58:22.341540 2950 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Advancing to term 9
W20260807 07:58:22.426345 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 132882us
I20260807 07:58:22.416909 31377 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260807 07:58:22.421093 2989 log.cc:927] Time spent T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
W20260807 07:58:22.426743 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 150914us
I20260807 07:58:22.434571 30429 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:22.478467 30579 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
W20260807 07:58:22.482681 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 105507us
I20260807 07:58:22.494946 30476 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:58:22.487792 31372 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:22.507400 30429 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:22.509305 30579 raft_consensus.cc:1240] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 3. Current term is 4. Ops: []
I20260807 07:58:22.511538 2962 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260807 07:58:22.490758 2882 raft_consensus.cc:2749] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:22.515496 30429 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:58:22.528678 30489 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:22.529608 30482 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260807 07:58:22.537845 30459 tablet_service.cc:1558] Processing DeleteTablet for tablet 61ca595a07a748bb83b4aa11cb066270 with delete_type TABLET_DATA_TOMBSTONED (TS ef1ca7acf52a438f89f14707e9e06818 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:33906
I20260807 07:58:22.543195 30372 raft_consensus.cc:1275] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:58:22.547612 2882 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 07:58:22.551508 30478 raft_consensus.cc:1275] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260807 07:58:22.551895 30478 pending_rounds.cc:85] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818: Aborting all ops after (but not including) 5
I20260807 07:58:22.552134 30478 pending_rounds.cc:107] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260807 07:58:22.555169 30478 raft_consensus.cc:2889] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:58:22.557943 30579 raft_consensus.cc:1275] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260807 07:58:22.564429 2745 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260807 07:58:22.561836 2972 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:22.569080 2972 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:22.551638 2882 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:22.572351 2882 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:22.577719 2958 consensus_queue.cc:1059] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:22.578738 30221 catalog_manager.cc:5697] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:22.581004 2991 consensus_queue.cc:1048] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260807 07:58:22.587244 2997 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:58:22.588855 2912 raft_consensus.cc:3055] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:58:22.596338 2912 raft_consensus.cc:740] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:22.597240 2912 consensus_queue.cc:260] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:22.590976 31383 raft_consensus.cc:1275] T a6acbd1341f44b138a96457c583930e4 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260807 07:58:22.604789 2867 consensus_queue.cc:1048] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:22.561463 2975 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260807 07:58:22.605139 2991 consensus_queue.cc:1048] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260807 07:58:22.639353 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 131898us
I20260807 07:58:22.644654 30223 catalog_manager.cc:5697] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 7 to 9, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 9 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:22.649456 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:22.649209 30223 catalog_manager.cc:5697] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 8 to 9, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 9 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:58:22.650724 30223 catalog_manager.cc:5697] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e reported cstate change: term changed from 4 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 6 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:22.656512 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:22.663367 2992 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260807 07:58:22.681442 2882 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:22.682799 30478 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260807 07:58:22.686684 31376 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 07:58:22.687587 2882 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:22.663545 2887 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260807 07:58:22.683768 31377 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:58:22.689688 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:58:22.698928 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 155153us
I20260807 07:58:22.641398 2972 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:22.719372 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:22.744314 30585 raft_consensus.cc:1275] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 07:58:22.745008 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:22.750546 2501 raft_consensus.cc:1064] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:58:22.751945 30579 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:58:22.718928 2911 consensus_queue.cc:1048] T a6acbd1341f44b138a96457c583930e4 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260807 07:58:22.718772 2882 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260807 07:58:22.745065 2758 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260807 07:58:22.783299 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 234562us
I20260807 07:58:22.793068 31376 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEARNER]: Advancing to term 7
W20260807 07:58:22.828919 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 84255.6us
I20260807 07:58:22.830502 30539 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:58:22.832664 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 72468.3us
W20260807 07:58:22.849009 31336 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:22.840462 2972 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:22.844170 2745 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260807 07:58:22.896637 30478 raft_consensus.cc:1240] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260807 07:58:22.883409 3007 tablet_replica.cc:333] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818: stopping tablet replica
W20260807 07:58:22.914908 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 156360us
I20260807 07:58:22.918965 30429 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
W20260807 07:58:22.920236 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 170644us
I20260807 07:58:22.898157 2758 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:22.850185 2501 consensus_queue.cc:237] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:22.924185 3024 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260807 07:58:22.923159 3020 consensus_queue.cc:1059] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260807 07:58:22.927825 2758 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:22.995127 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 50686.9us
I20260807 07:58:22.924084 2962 consensus_queue.cc:1048] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260807 07:58:22.942684 3023 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:22.930446 2696 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260807 07:58:23.009124 3023 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:23.047946 3023 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:23.058864 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:23.060141 31376 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:58:23.091188 3000 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:58:23.128443 2758 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:23.138466 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 71179.2us
I20260807 07:58:23.139012 2972 raft_consensus.cc:3055] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Stepping down as leader of term 9
I20260807 07:58:23.139478 2972 raft_consensus.cc:740] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:23.130280 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
W20260807 07:58:23.154033 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 211136us
I20260807 07:58:23.163395 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:23.164834 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:23.165220 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:23.167586 30372 raft_consensus.cc:1275] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:58:23.178701 30429 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:23.179518 2962 raft_consensus.cc:2749] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:23.180500 30429 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:23.185746 3023 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:23.262388 2912 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:23.332003 30223 catalog_manager.cc:5697] T 151ecad19f9e4079986c980524b2f3c0 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:23.333761 30579 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260807 07:58:23.358315 3052 log.cc:927] Time spent T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260807 07:58:23.365891 3024 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
W20260807 07:58:23.394080 3054 log.cc:927] Time spent T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.227s user 0.000s sys 0.001s
I20260807 07:58:23.410159 30363 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 07:58:23.341723 3050 consensus_queue.cc:1048] T 5b78e546552f4ce38217f522549d6f36 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260807 07:58:23.412497 30221 catalog_manager.cc:5697] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:23.461352 31383 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEARNER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260807 07:58:23.465209 3048 log.cc:927] Time spent T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.212s user 0.000s sys 0.001s
I20260807 07:58:23.402879 2972 consensus_queue.cc:260] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:23.486801 2963 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:23.487720 2963 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:23.492545 2972 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:23.497836 30482 raft_consensus.cc:1240] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260807 07:58:23.574501 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 56640.2us
W20260807 07:58:23.574783 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 59981.4us
I20260807 07:58:23.515671 3023 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260807 07:58:23.587141 3029 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 07:58:23.576470 3007 raft_consensus.cc:2243] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:23.575397 3011 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:23.597644 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:23.600016 3007 raft_consensus.cc:2272] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:23.590113 3011 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:23.616966 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:58:23.638275 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 331856us
I20260807 07:58:23.658924 2758 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:23.659581 2758 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:23.664739 2963 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:23.681131 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:23.681949 30586 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 9.
I20260807 07:58:23.692339 31338 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:23.694203 3011 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:23.707883 2963 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 07:58:23.708446 2963 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:23.708932 2963 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:23.713744 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:23.714569 30586 raft_consensus.cc:2393] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 9: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:23.689736 3024 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:23.717937 3024 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:23.722066 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:23.722864 30586 raft_consensus.cc:2393] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 4: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:23.723517 3007 ts_tablet_manager.cc:1916] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:23.721174 3024 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:23.735100 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:23.735733 31384 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:58:23.745934 2961 raft_consensus.cc:1064] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19: attempting to promote NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa to VOTER
I20260807 07:58:23.772981 30430 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:58:23.793613 2758 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:23.794942 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:23.787770 2846 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:58:23.791057 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:23.821924 2846 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:23.852859 2846 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:23.855059 2961 consensus_queue.cc:237] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:23.904136 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 54250us
I20260807 07:58:23.883813 2963 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:23.913201 31377 raft_consensus.cc:2368] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 9. Current term is 10.
I20260807 07:58:23.915084 30323 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:23.919683 2697 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:23.920704 2758 raft_consensus.cc:2955] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:23.937328 2846 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:23.938302 30373 raft_consensus.cc:2955] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:23.949121 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:23.949834 30478 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 10
I20260807 07:58:23.959945 30430 leader_election.cc:400] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619) with higher term. Message: Invalid argument: T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 9. Current term is 10.
I20260807 07:58:23.960552 30430 leader_election.cc:403] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:58:23.967221 3007 ts_tablet_manager.cc:1929] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260807 07:58:23.967729 3007 log.cc:1199] T 61ca595a07a748bb83b4aa11cb066270 P ef1ca7acf52a438f89f14707e9e06818: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-1-root/wals/61ca595a07a748bb83b4aa11cb066270
I20260807 07:58:23.968900 3007 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33906 (request call id 80) took 1550 ms. Trace:
I20260807 07:58:23.950939 2963 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:23.975116 30480 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:23.976595 3011 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:23.976990 2846 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:23.976583 31377 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEARNER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:23.979594 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:23.980934 30478 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 10.
I20260807 07:58:23.981443 2846 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619) with higher term. Message: Invalid argument: T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 9. Current term is 10.
I20260807 07:58:23.980207 31376 raft_consensus.cc:2955] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:23.985954 3011 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:58:23.988241 31336 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:23.990038 2963 raft_consensus.cc:2804] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Leader election won for term 10
I20260807 07:58:23.990602 2963 raft_consensus.cc:697] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:23.991739 2963 consensus_queue.cc:237] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:24.011234 30221 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53640 (request call id 377) took 1306 ms. Trace:
I20260807 07:58:24.011698 30221 rpcz_store.cc:276] 0807 07:58:22.704457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:22.704599 (+ 142us) service_pool.cc:224] Handling call
0807 07:58:24.011160 (+1306561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:58:23.709064 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:58:23.728416 (+ 19352us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:58:23.728450 (+ 34us) write_op.cc:435] Acquired schema lock
0807 07:58:23.728463 (+ 13us) tablet.cc:662] Decoding operations
0807 07:58:23.728880 (+ 417us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:58:23.728929 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0807 07:58:23.728981 (+ 52us) tablet.cc:685] Acquiring locks for 1 operations
0807 07:58:23.742421 (+ 13440us) tablet.cc:701] Row locks acquired
0807 07:58:23.742437 (+ 16us) write_op.cc:260] PREPARE: finished
0807 07:58:23.742653 (+ 216us) write_op.cc:270] Start()
0807 07:58:23.742878 (+ 225us) write_op.cc:276] Timestamp: P: 1786089503742577 usec, L: 0
0807 07:58:23.742897 (+ 19us) op_driver.cc:348] REPLICATION: starting
0807 07:58:23.826422 (+ 83525us) log.cc:844] Serialized 599 byte log entry
0807 07:58:23.957864 (+131442us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b54002a1a54. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f2208 00007fd6b8d4bf61 00007fd6b8d4b738 00007fd6b8d503d1 00007fd6b8d50389 00007fd6b8d50319 00007fd6b8d502e1 00007fd6b8d4f50d 00000000003aa554 00000000003aa399
0807 07:58:23.964797 (+ 6933us) op_driver.cc:464] REPLICATION: finished
0807 07:58:23.975842 (+ 11045us) write_op.cc:301] APPLY: starting
0807 07:58:23.975934 (+ 92us) tablet.cc:1367] starting BulkCheckPresence
0807 07:58:23.976049 (+ 115us) tablet.cc:1370] finished BulkCheckPresence
0807 07:58:23.976069 (+ 20us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:58:23.976296 (+ 227us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:58:23.983764 (+ 7468us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 07:58:23.983843 (+ 79us) write_op.cc:312] APPLY: finished
0807 07:58:23.984186 (+ 343us) log.cc:844] Serialized 23 byte log entry
0807 07:58:23.984381 (+ 195us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:23.984511 (+ 130us) write_op.cc:454] Released schema lock
0807 07:58:23.984579 (+ 68us) write_op.cc:341] FINISH: Updating metrics
0807 07:58:23.989471 (+ 4892us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:23.989858 (+ 387us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":74,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":10752,"apply.run_cpu_time_us":2032,"apply.run_wall_time_us":11407,"num_ops":1,"prepare.queue_time_us":253137,"prepare.run_cpu_time_us":11738,"prepare.run_wall_time_us":249011,"replication_time_us":221751,"spinlock_wait_cycles":58389888}]]}
I20260807 07:58:23.969285 3007 rpcz_store.cc:276] 0807 07:58:22.432388 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:22.535900 (+103512us) service_pool.cc:224] Handling call
0807 07:58:22.845290 (+309390us) ts_tablet_manager.cc:1151] Deleting tablet 61ca595a07a748bb83b4aa11cb066270
0807 07:58:22.850563 (+ 5273us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0807 07:58:23.889828 (+1039265us) tablet_metadata.cc:665] Metadata flushed
0807 07:58:23.967075 (+ 77247us) tablet_metadata.cc:665] Metadata flushed
0807 07:58:23.968813 (+ 1738us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":502905,"tablet-delete.queue_time_us":246516,"thread_start_us":223993,"threads_started":1}
I20260807 07:58:24.025033 30201 catalog_manager.cc:5028] TS ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917): tablet 61ca595a07a748bb83b4aa11cb066270 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:24.036201 30223 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53656 (request call id 410) took 1298 ms. Trace:
I20260807 07:58:24.036582 30223 rpcz_store.cc:276] 0807 07:58:22.737977 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:22.738355 (+ 378us) service_pool.cc:224] Handling call
0807 07:58:24.036137 (+1297782us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:58:23.672197 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:58:23.673021 (+ 824us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:58:23.673060 (+ 39us) write_op.cc:435] Acquired schema lock
0807 07:58:23.673076 (+ 16us) tablet.cc:662] Decoding operations
0807 07:58:23.674143 (+ 1067us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:58:23.674224 (+ 81us) write_op.cc:641] Partition lock acquired for write op
0807 07:58:23.674312 (+ 88us) tablet.cc:685] Acquiring locks for 1 operations
0807 07:58:23.674653 (+ 341us) tablet.cc:701] Row locks acquired
0807 07:58:23.674674 (+ 21us) write_op.cc:260] PREPARE: finished
0807 07:58:23.674896 (+ 222us) write_op.cc:270] Start()
0807 07:58:23.675021 (+ 125us) write_op.cc:276] Timestamp: P: 1786089503674848 usec, L: 0
0807 07:58:23.675075 (+ 54us) op_driver.cc:348] REPLICATION: starting
0807 07:58:23.676131 (+ 1056us) log.cc:844] Serialized 536 byte log entry
0807 07:58:23.708473 (+ 32342us) spinlock_profiling.cc:243] Waited 9.84 ms on lock 0x7b54000ecca0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b5260470 00007fd6b526da98 00007fd6b526d6da 00007fd6b52f1d45 00007fd6b52f21e9 00007fd6b8d4bf61 00007fd6b8d4b738 00007fd6b8d503d1 00007fd6b8d50389 00007fd6b8d50319 00007fd6b8d502e1
0807 07:58:23.903686 (+195213us) op_driver.cc:464] REPLICATION: finished
0807 07:58:23.956215 (+ 52529us) write_op.cc:301] APPLY: starting
0807 07:58:23.956307 (+ 92us) tablet.cc:1367] starting BulkCheckPresence
0807 07:58:23.956417 (+ 110us) tablet.cc:1370] finished BulkCheckPresence
0807 07:58:23.956441 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:58:23.956707 (+ 266us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:58:23.956868 (+ 161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 07:58:23.956903 (+ 35us) write_op.cc:312] APPLY: finished
0807 07:58:23.957113 (+ 210us) log.cc:844] Serialized 23 byte log entry
0807 07:58:23.957279 (+ 166us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:23.957357 (+ 78us) write_op.cc:454] Released schema lock
0807 07:58:23.957423 (+ 66us) write_op.cc:341] FINISH: Updating metrics
0807 07:58:23.958213 (+ 790us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:23.958244 (+ 31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":26368,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":51018,"apply.run_cpu_time_us":1648,"apply.run_wall_time_us":1982,"num_ops":1,"prepare.queue_time_us":284677,"prepare.run_cpu_time_us":7612,"prepare.run_wall_time_us":67199,"replication_time_us":215723,"spinlock_wait_cycles":22643968,"thread_start_us":193551,"threads_started":2}]]}
I20260807 07:58:24.045363 30590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:24.045940 30590 raft_consensus.cc:606] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 6 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
W20260807 07:58:24.048681 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 162880us
W20260807 07:58:24.061798 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 213492us
I20260807 07:58:24.073350 31378 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:58:24.078874 30430 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:24.083303 3050 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:58:24.086261 3050 raft_consensus.cc:697] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:24.087067 3050 consensus_queue.cc:237] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:24.091452 30585 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:24.095016 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:24.095785 30582 raft_consensus.cc:2393] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 4: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:24.099495 30585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:24.100073 30585 raft_consensus.cc:606] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 10 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:24.113142 30221 catalog_manager.cc:5697] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index 7 to 8, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:24.117270 30585 raft_consensus.cc:2955] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:24.131301 30366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfc043461f2840a385956057685df8f9"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:24.131872 30366 raft_consensus.cc:606] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:24.134135 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 07:58:24.135998 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:24.157716 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:24.158365 30590 raft_consensus.cc:3060] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:24.143453 2948 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260807 07:58:24.193333 30590 raft_consensus.cc:2468] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 10.
I20260807 07:58:24.126019 3000 raft_consensus.cc:2955] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 4 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:24.186719 31380 raft_consensus.cc:2955] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 4 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:24.288620 30582 raft_consensus.cc:2955] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 4 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:24.278679 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:24.297746 30487 raft_consensus.cc:2955] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 4 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:24.300922 2798 raft_consensus.cc:993] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:24.303009 2798 raft_consensus.cc:1081] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 6 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:24.340934 2785 raft_consensus.cc:993] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:24.341455 2785 raft_consensus.cc:1081] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 10 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:24.358278 30219 catalog_manager.cc:5697] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:24.360136 30219 catalog_manager.cc:5697] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 4 to 6, 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } attrs { replace: true } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:24.362680 30489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33916
I20260807 07:58:24.363385 30489 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:24.363732 30489 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:24.365583 30363 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45054
I20260807 07:58:24.366137 30363 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:24.366444 30363 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:24.373831 30363 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:24.376798 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:24.377331 30487 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:24.385814 30363 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 11 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:24.390872 30487 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 11.
I20260807 07:58:24.392017 30317 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:24.392817 2999 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Leader election won for term 11
I20260807 07:58:24.393302 2999 raft_consensus.cc:697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 11 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:24.394192 2999 consensus_queue.cc:237] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:24.410169 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:24.410773 30582 raft_consensus.cc:3055] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 10 LEADER]: Stepping down as leader of term 10
I20260807 07:58:24.411072 30582 raft_consensus.cc:740] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:24.412174 30582 consensus_queue.cc:260] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:24.413535 30582 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:24.427136 30489 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:24.429107 30489 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:24.430014 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:24.430434 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:24.430585 30363 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:24.431077 30586 raft_consensus.cc:3055] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:24.431409 30586 raft_consensus.cc:740] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:24.432116 30586 consensus_queue.cc:260] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:24.433275 30586 raft_consensus.cc:3060] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:24.439831 30363 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:24.441677 30429 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:24.442539 3050 raft_consensus.cc:2804] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:24.442998 3050 raft_consensus.cc:697] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:24.443303 30366 consensus_queue.cc:237] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:24.443758 3050 consensus_queue.cc:237] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:24.446260 30582 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 11.
I20260807 07:58:24.454300 30586 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:24.457010 31380 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 07:58:24.457792 30489 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 07:58:24.458559 2961 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:24.459321 2999 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:24.466060 2697 raft_consensus.cc:2955] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:24.467680 30489 raft_consensus.cc:2955] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:24.483827 30203 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5cb72552d8da48b78c58110bb0c84f61 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260807 07:58:24.492652 30582 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260807 07:58:24.494994 2794 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 07:58:24.504522 30221 catalog_manager.cc:5697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 10 to 11, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 11 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:24.524701 30586 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 07:58:24.526371 2846 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:24.548260 31380 raft_consensus.cc:2955] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:24.549194 30223 catalog_manager.cc:5697] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 3 to 4, leader changed from 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:24.575695 30489 raft_consensus.cc:1275] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260807 07:58:24.577551 3012 consensus_queue.cc:1048] T 457aab41fd17414ab083fedaf23f3ff8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 07:58:24.632287 30221 catalog_manager.cc:5697] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: config changed from index 6 to 7, VOTER f831a53ec51d452398015797d543164e (127.27.64.131) evicted. New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:24.633153 30487 consensus_queue.cc:237] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:24.636044 31376 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260807 07:58:24.643394 2961 raft_consensus.cc:993] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:24.643952 2961 raft_consensus.cc:1081] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Signalling peer ef1ca7acf52a438f89f14707e9e06818 to start an election
I20260807 07:58:24.645126 2846 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:24.646483 2785 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:24.647054 2785 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:24.648360 2961 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:24.648862 2961 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:24.649959 2785 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:24.651690 2961 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:24.652534 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:24.653220 30478 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 10.
I20260807 07:58:24.654470 30539 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:24.656366 2798 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 07:58:24.656795 2798 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:24.657320 2798 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:24.660981 30564 tablet_service.cc:1558] Processing DeleteTablet for tablet 5cb72552d8da48b78c58110bb0c84f61 with delete_type TABLET_DATA_TOMBSTONED (TS f831a53ec51d452398015797d543164e not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34588
I20260807 07:58:24.666458 30482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfc043461f2840a385956057685df8f9"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:33928
I20260807 07:58:24.667048 30482 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:24.667382 30482 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:24.678027 30482 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:24.679868 30482 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:24.678467 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:24.682106 30480 raft_consensus.cc:2393] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 10: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:24.682787 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:24.683357 30373 raft_consensus.cc:3055] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:58:24.683650 30373 raft_consensus.cc:740] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:24.691972 3093 tablet_replica.cc:333] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e: stopping tablet replica
I20260807 07:58:24.694370 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:24.694459 30373 consensus_queue.cc:260] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:24.695011 31380 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:24.695842 30373 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:24.697664 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:24.698669 30366 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 9.
I20260807 07:58:24.701967 3093 raft_consensus.cc:2243] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:24.710229 31380 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:58:24.715466 30430 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:24.717255 30373 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:58:24.719779 3050 raft_consensus.cc:2804] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:58:24.743327 3093 raft_consensus.cc:2272] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:24.739935 31372 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:58:24.742158 3050 raft_consensus.cc:697] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:24.781018 3050 consensus_queue.cc:237] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:24.789692 2846 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:24.795775 30585 raft_consensus.cc:1275] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:58:24.776674 3093 ts_tablet_manager.cc:1916] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:24.801810 30222 catalog_manager.cc:5697] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 6 to 7, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 7 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:24.817677 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:24.846011 3050 consensus_queue.cc:1048] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260807 07:58:24.866204 2798 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:24.868427 2798 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:24.869092 30590 raft_consensus.cc:2368] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 10. Current term is 11.
I20260807 07:58:24.878475 2846 raft_consensus.cc:2955] T f16f3d2817a34261bb25577fa0f9e2de P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
W20260807 07:58:24.888453 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 46658.9us
I20260807 07:58:24.890890 3093 ts_tablet_manager.cc:1929] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260807 07:58:24.891393 3093 log.cc:1199] T 5cb72552d8da48b78c58110bb0c84f61 P f831a53ec51d452398015797d543164e: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-2-root/wals/5cb72552d8da48b78c58110bb0c84f61
I20260807 07:58:24.893244 30203 catalog_manager.cc:5028] TS f831a53ec51d452398015797d543164e (127.27.64.131:33207): tablet 5cb72552d8da48b78c58110bb0c84f61 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:24.894860 30320 leader_election.cc:400] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 10. Current term is 11.
I20260807 07:58:24.895223 30320 leader_election.cc:403] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:58:24.895788 2949 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Advancing to term 11
I20260807 07:58:24.898080 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:24.898679 30480 raft_consensus.cc:3060] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:24.903180 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:24.903676 2949 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 10. Current term is 11.
I20260807 07:58:24.906276 31372 raft_consensus.cc:2955] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:24.916165 30373 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 11.
I20260807 07:58:24.917646 30541 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:24.918538 2992 raft_consensus.cc:2804] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader election won for term 11
I20260807 07:58:24.919008 2992 raft_consensus.cc:697] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [term 11 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:24.919752 2992 consensus_queue.cc:237] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:24.924870 30564 tablet_service.cc:1558] Processing DeleteTablet for tablet 5cb72552d8da48b78c58110bb0c84f61 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:34588
I20260807 07:58:24.926281 30203 catalog_manager.cc:5028] TS f831a53ec51d452398015797d543164e (127.27.64.131:33207): tablet 5cb72552d8da48b78c58110bb0c84f61 (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:24.930848 30480 raft_consensus.cc:2468] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 11.
I20260807 07:58:24.931975 30586 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260807 07:58:24.933195 30201 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f16f3d2817a34261bb25577fa0f9e2de with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260807 07:58:24.934525 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 125321us
I20260807 07:58:24.935885 3096 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260807 07:58:24.933539 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 90542.7us
I20260807 07:58:24.966939 30584 raft_consensus.cc:2955] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:24.969024 30219 catalog_manager.cc:5697] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: config changed from index 8 to 9, VOTER b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) evicted. New cstate: current_term: 8 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:24.972529 30585 raft_consensus.cc:1275] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:24.992839 30345 tablet_service.cc:1558] Processing DeleteTablet for tablet f16f3d2817a34261bb25577fa0f9e2de with delete_type TABLET_DATA_TOMBSTONED (TS b1188d7d3a0b455894bc443d571f6a19 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:45034
I20260807 07:58:24.998286 2846 consensus_queue.cc:1048] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:25.002281 30221 catalog_manager.cc:5697] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:58:25.007023 30480 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260807 07:58:25.012461 3102 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:25.041630 30219 catalog_manager.cc:5697] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 4 to 5, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:25.043767 3110 tablet_replica.cc:333] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19: stopping tablet replica
I20260807 07:58:25.048601 3110 raft_consensus.cc:2243] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260807 07:58:25.049537 3110 raft_consensus.cc:2272] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260807 07:58:25.052471 3110 ts_tablet_manager.cc:1916] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260807 07:58:25.081903 30373 raft_consensus.cc:1275] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:25.087606 2980 consensus_queue.cc:1048] T 488daa184a3f4a30a48872c9fc1612dd P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260807 07:58:25.119225 3110 ts_tablet_manager.cc:1929] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260807 07:58:25.120095 3110 log.cc:1199] T f16f3d2817a34261bb25577fa0f9e2de P b1188d7d3a0b455894bc443d571f6a19: Deleting WAL directory at /tmp/dist-test-task2Vjafd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1786089331872967-27906-0/minicluster-data/ts-0-root/wals/f16f3d2817a34261bb25577fa0f9e2de
I20260807 07:58:25.145623 30203 catalog_manager.cc:5028] TS b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407): tablet f16f3d2817a34261bb25577fa0f9e2de (table test-workload [id=e1e3f7e270dc41faaa51aac5094f1280]) successfully deleted
I20260807 07:58:25.193979 31376 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:58:25.202381 3099 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:58:25.262409 30363 raft_consensus.cc:1275] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:58:25.264900 2980 consensus_queue.cc:1048] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:58:25.380663 30363 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260807 07:58:25.388268 2867 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:25.454058 30480 raft_consensus.cc:1275] T 1906743dbae54f6b90d1d039e2394d50 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260807 07:58:25.531064 2992 consensus_queue.cc:1048] T 1906743dbae54f6b90d1d039e2394d50 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:25.654511 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:25.815822 30363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:25.816453 30363 raft_consensus.cc:606] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:25.819290 30480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:25.819836 30480 raft_consensus.cc:606] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:25.822333 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260807 07:58:25.824088 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
I20260807 07:58:25.824885 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:25.996635 2846 raft_consensus.cc:993] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:25.997174 2846 raft_consensus.cc:1081] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:26.010396 30373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:26.010978 30373 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:26.011364 30373 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:26.018409 3000 raft_consensus.cc:993] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19: : Instructing follower f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:26.020174 30373 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:26.027751 3128 raft_consensus.cc:1081] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Signalling peer f831a53ec51d452398015797d543164e to start an election
I20260807 07:58:26.031081 30373 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:27.126675 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 94144.7us
I20260807 07:58:27.128469 3133 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.151978 3133 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.154044 3133 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.160457 3133 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.161046 3133 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.163269 3133 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.163873 3133 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.165586 3133 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.170222 3133 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.161334 3137 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.171627 3137 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.204851 3137 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.206811 3139 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.207346 3139 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.218480 3139 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.257524 3148 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:27.259536 3148 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.267364 3148 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.269054 3148 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.270332 3142 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.272233 3146 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.272634 3139 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.270054 3148 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.274268 3139 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.277082 3144 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.277258 3135 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.278555 3144 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.279677 30363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45054 (request call id 2522) took 1249 ms. Trace:
I20260807 07:58:27.278774 3135 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.280323 30363 rpcz_store.cc:276] 0807 07:58:26.030489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:27.277256 (+1246767us) service_pool.cc:224] Handling call
0807 07:58:27.278248 (+ 992us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:27.278883 (+ 635us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:27.278935 (+ 52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:27.279006 (+ 71us) raft_consensus.cc:1645] Marking committed up to 7
0807 07:58:27.279034 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:27.279139 (+ 105us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:27.279354 (+ 215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260807 07:58:27.273528 3146 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.287068 3148 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.287838 3148 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.288345 3146 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.271472 3142 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.288748 3148 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.291085 3142 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.291380 3148 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.291729 3142 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.292749 2794 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.292667 3142 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.293738 2794 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.285208 3144 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.296458 2794 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.296623 3142 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.279841 3145 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.304690 3146 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.305660 3146 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.308534 3146 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.303870 3135 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.325860 3145 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.316931 3148 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.337160 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.338555 31378 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:58:27.338092 3148 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.344206 3145 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.347779 3149 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.349156 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.355461 2794 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.365502 3149 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.366024 2794 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.369108 3149 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.361425 3148 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.362279 3135 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.364543 3144 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.369534 2794 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.359683 3145 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.394870 3144 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.398025 2794 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.399024 2794 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.393074 3142 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:27.402969 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.402901 3145 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.406196 3135 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.407593 3154 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.408305 3154 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.413592 31380 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:27.410152 3149 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.411657 3145 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.414464 3149 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.412580 3144 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.402002 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.414666 2946 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.412358 3148 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.421649 2946 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.423727 3148 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.437588 3125 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.438804 3125 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.440861 3145 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.441489 3145 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.443691 2946 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.446841 2676 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:27.447633 2676 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.423942 3149 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.570278 3145 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.570410 3149 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.570688 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.510464 3153 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.489133 3155 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:27.571487 31383 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:27.510586 3124 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.513067 3144 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.547178 2676 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.509862 3152 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.451479 3148 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.452855 3154 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.546545 3125 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.494503 2980 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.452342 3161 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.453935 3157 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.488315 2946 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.456636 3150 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.571347 3149 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.488747 3156 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:27.613632 30430 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:27.452541 3142 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.614691 3124 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.625914 3124 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.615056 3167 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.626904 3167 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.612676 3153 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.607141 3145 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.620298 2980 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.634135 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.636030 2980 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.629355 3167 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.616015 3125 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.607877 3148 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.609886 3154 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:27.634275 3145 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.617130 2946 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.640390 3145 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.638310 3154 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.642997 3154 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.605671 2676 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.576649 3155 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.649933 3125 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.629514 3168 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:27.620186 3157 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.621901 3149 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.657490 3157 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.658352 3168 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.631109 3150 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.660655 3168 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.660776 3150 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:27.632558 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 56845.5us
I20260807 07:58:27.638500 3148 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.663214 30430 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:27.663867 3148 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.643535 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.644450 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.623327 3166 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.665609 3172 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.614394 3152 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.644937 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.645148 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.667105 30581 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 4.
I20260807 07:58:27.632866 3173 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:27.668603 3173 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.668998 3173 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:27.650315 3155 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.631347 3156 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.672428 3156 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.589291 3144 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.647249 2946 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.653836 3124 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:27.674615 3144 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.666306 3172 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.623178 3142 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.675504 3135 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.676570 3152 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.633085 3153 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.676573 3172 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.674320 3124 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.666208 3166 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.679382 3124 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.648229 2676 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.680016 3166 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.681298 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.681557 3148 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:27.682030 31377 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 9.
I20260807 07:58:27.682704 30430 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:27.685530 3153 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.686010 2846 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:27.686434 2846 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.686683 3178 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.687444 3178 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.686793 2846 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:27.689707 3178 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.690243 3178 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.690738 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.691089 3172 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.693751 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.694449 30488 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:58:27.691738 3172 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.681339 2676 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.686260 3153 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.698098 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.699747 3153 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.682046 3148 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.700585 3148 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:27.701272 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.701514 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.702189 30490 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 12.
I20260807 07:58:27.703908 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.704568 30488 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:58:27.706244 30430 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:27.707178 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.707844 30479 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 11.
I20260807 07:58:27.710692 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.711346 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.711498 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.711763 3139 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.712350 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.712700 3156 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:27.700788 31338 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:27.714478 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.713819 30482 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:58:27.710767 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.717098 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.717638 3135 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:58:27.717677 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.719266 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
W20260807 07:58:27.719682 30317 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.702s user 0.002s sys 0.025s
I20260807 07:58:27.720543 3135 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.722759 3135 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:27.713430 3156 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.718585 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.727116 31377 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:27.735069 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.735376 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.735841 30581 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 7.
I20260807 07:58:27.736833 3000 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:27.737497 3000 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.739905 3150 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.740182 3153 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.745810 2949 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.710564 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.746456 2949 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.752642 3160 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.754024 2949 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.755602 2794 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.756682 2949 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.757368 2949 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.751195 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.739764 3000 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.751016 3169 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.760917 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.749100 3150 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.740994 3153 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.774422 30430 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
W20260807 07:58:27.774223 30317 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.756s user 0.005s sys 0.026s
I20260807 07:58:27.714457 3168 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 07:58:27.776575 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.780498 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.690832 3178 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.760567 3156 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.629760 3161 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:27.784325 30267 debug-util.cc:398] Leaking SignalData structure 0x7b0800307340 after lost signal to thread 27911
I20260807 07:58:27.786208 2846 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.771944 3125 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.775197 3124 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.791316 2946 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
W20260807 07:58:27.791869 30267 debug-util.cc:398] Leaking SignalData structure 0x7b080023ab00 after lost signal to thread 30272
I20260807 07:58:27.792138 3156 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.785912 3139 raft_consensus.cc:2804] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:27.800215 3156 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.800920 3139 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.798074 30480 raft_consensus.cc:1240] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 6. Current term is 7. Ops: []
I20260807 07:58:27.801411 3139 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:27.801780 2946 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.798235 3169 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.798336 3182 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.803884 2946 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:27.799324 30267 debug-util.cc:398] Leaking SignalData structure 0x7b08003156a0 after lost signal to thread 30405
I20260807 07:58:27.804355 3182 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.799500 3150 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.805271 3169 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.787274 3168 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.805871 3168 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:27.806713 3182 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:58:27.808476 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 50286.4us
W20260807 07:58:27.810110 30267 debug-util.cc:398] Leaking SignalData structure 0x7b080003f940 after lost signal to thread 30521
I20260807 07:58:27.813027 3000 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.813719 3000 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.814574 3156 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.814903 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.815793 3000 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.816947 3179 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:58:27.817359 30267 debug-util.cc:398] Leaking SignalData structure 0x7b080036d280 after lost signal to thread 30627
W20260807 07:58:27.823441 30267 debug-util.cc:398] Leaking SignalData structure 0x7b080035ed00 after lost signal to thread 30628
I20260807 07:58:27.811371 3135 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.818833 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.799264 3172 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.825676 31377 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:58:27.825838 30586 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615"
dest_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34604
I20260807 07:58:27.826531 30586 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:27.777313 3167 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.789186 2949 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.812922 2946 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.821918 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.827531 3167 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.753270 3160 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.827718 2946 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.827821 30477 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 7.
I20260807 07:58:27.826905 30586 raft_consensus.cc:3060] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:27.822108 2846 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.836194 3160 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.837631 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.839284 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.831823 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:27.840427 30581 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:27.829000 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.841161 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.844144 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.826049 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:27.888265 30581 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:27.875240 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.850914 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:27.856383 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.858078 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.836436 2946 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.831226 3182 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.857249 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.877259 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.909296 30476 raft_consensus.cc:2468] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:58:27.887598 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.881018 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:27.909520 30477 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 5.
I20260807 07:58:27.855798 30586 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.847755 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:58:27.909638 30267 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3a80 after lost signal to thread 31418
I20260807 07:58:27.906263 30490 raft_consensus.cc:3055] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:27.908241 30542 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:27.888715 3135 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.906304 2949 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:27.920907 31336 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:27.922024 3186 raft_consensus.cc:2804] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:27.922436 3186 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.922780 3186 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:27.923789 3139 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.936337 30480 raft_consensus.cc:2393] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 9: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:27.937811 3145 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:27.938390 3145 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.940481 3145 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.941008 3145 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
W20260807 07:58:27.941640 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 47870.4us
I20260807 07:58:27.941646 3145 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.917481 30490 raft_consensus.cc:740] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:27.944021 3145 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.944916 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:27.945725 31377 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:58:27.946251 3000 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.946875 3000 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.862027 3179 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.948078 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:27.948632 31377 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:27.949023 30430 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:27.949331 3000 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.943840 30490 consensus_queue.cc:260] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.950220 3179 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.950361 30490 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:27.951241 3139 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.912581 30479 raft_consensus.cc:2393] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 7: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:27.886193 3161 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.919539 30586 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.847898 3167 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.924108 3182 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.920950 2949 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.927685 3156 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:27.928099 3155 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.844924 3124 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.932516 3178 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.932964 3153 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.933086 31336 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:27.939230 3186 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.944890 3188 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:27.957264 31377 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 9.
I20260807 07:58:27.974282 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.976590 30490 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:27.959020 3139 raft_consensus.cc:2804] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:27.979650 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.980973 30588 raft_consensus.cc:1240] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7. Ops: []
I20260807 07:58:27.981622 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.982597 3173 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.012594 3173 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.984350 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.985204 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:27.985291 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.987964 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.013875 30487 raft_consensus.cc:1240] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:28.015115 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.015430 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:28.009862 3139 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:28.016316 3186 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:27.989609 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.016580 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.017160 30373 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 9.
I20260807 07:58:28.014652 3188 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:27.990020 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:27.990597 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.019965 3188 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:27.991839 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.010365 30579 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 11.
I20260807 07:58:27.993638 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:27.993820 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:27.995105 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.016484 3139 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:28.022358 3182 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:28.022717 30430 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:28.023561 3145 raft_consensus.cc:2804] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 07:58:28.024070 3145 raft_consensus.cc:697] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:27.959506 30539 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:27.997835 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.002250 3124 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:28.004043 2949 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:27.998342 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.006471 3179 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.042691 3179 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:27.989192 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.021654 30590 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 12.
I20260807 07:58:27.995378 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.009220 3000 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:27.997859 3156 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:28.033346 31377 raft_consensus.cc:1240] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:58:28.033987 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.034664 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.035384 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.036263 30369 raft_consensus.cc:1240] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7. Ops: []
I20260807 07:58:28.036795 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.037544 3182 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260807 07:58:28.037879 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 78469.6us
I20260807 07:58:28.009171 30586 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:28.048731 30373 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:28.042603 30365 raft_consensus.cc:2468] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:58:28.008139 3168 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:28.043859 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 110979us
I20260807 07:58:28.049304 30539 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:28.051358 31336 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:28.051044 30372 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:58:28.051108 30360 raft_consensus.cc:2468] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 3.
I20260807 07:58:28.052366 30539 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:28.054294 30539 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:28.055058 30539 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:28.050724 3000 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.056380 3180 raft_consensus.cc:2804] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:28.056794 3180 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:28.057025 3179 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:28.057130 3180 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:28.053704 3178 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:28.024999 3145 consensus_queue.cc:237] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.064805 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.057587 3160 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260807 07:58:28.065572 3160 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:28.060067 3184 raft_consensus.cc:2804] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:28.066215 3184 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:28.066638 3184 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:28.049576 3182 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:28.057948 3000 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.060906 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.067737 30586 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:28.061493 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:27.998076 3148 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.068732 2846 consensus_queue.cc:1059] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:28.065953 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.072696 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.073150 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:28.074620 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.075080 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.075832 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.076802 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.072602 3182 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:28.057999 3172 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260807 07:58:28.045125 3186 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:28.065972 3160 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Advancing to term 13
I20260807 07:58:28.078323 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.073565 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:28.080137 30479 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:28.077915 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.075676 30590 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:28.077486 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.082501 30584 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:28.082765 3190 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.077430 30364 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:58:28.073242 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:28.083431 3190 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.075734 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.077872 3172 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:28.085871 30358 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:58:28.085996 3172 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Advancing to term 12
I20260807 07:58:28.087169 2846 raft_consensus.cc:3055] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:58:28.088160 2846 raft_consensus.cc:740] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:28.087687 30429 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:28.089883 30489 raft_consensus.cc:2393] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 8: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:28.090191 2846 consensus_queue.cc:260] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.090878 3148 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.091367 2846 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:28.046754 3155 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.092267 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:28.092880 31377 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:28.093259 3155 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.093750 3142 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 07:58:28.094151 3142 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.094456 3168 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.047771 3156 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:28.094527 3142 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:28.098901 30539 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:28.117744 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.118512 30586 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:28.119266 3178 raft_consensus.cc:2749] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:28.121835 30539 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:28.122664 3178 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:28.123071 3178 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:28.123411 3178 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:28.127485 30429 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:28.127027 3189 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.135483 3124 consensus_queue.cc:1059] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:28.136256 3173 raft_consensus.cc:2804] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:58:28.136642 3167 raft_consensus.cc:3055] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:28.136255 30429 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:28.131907 3191 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:28.138260 30429 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:28.139837 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.128345 3188 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:28.137089 3167 raft_consensus.cc:740] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:28.136818 3173 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.127745 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:28.152874 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.149323 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.139068 3168 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:28.150179 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.150460 30429 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:28.152750 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.154512 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.149071 30479 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 8.
I20260807 07:58:28.148429 31338 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:28.125646 3190 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.127966 3000 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:28.153735 30480 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:58:28.121832 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:28.157425 30429 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:28.157646 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.157647 31338 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:28.159961 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.158704 31336 leader_election.cc:304] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:28.161612 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.161932 2846 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:28.162266 30476 raft_consensus.cc:2393] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 7: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:58:28.161499 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.163417 31338 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:28.164741 3192 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:28.164989 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.165506 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:28.165638 30482 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 10.
I20260807 07:58:28.166532 3174 raft_consensus.cc:2804] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:28.166971 3174 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.167356 3174 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:28.159772 3186 raft_consensus.cc:2749] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:28.165426 3192 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.169945 3167 consensus_queue.cc:260] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.162163 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.171401 3167 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:28.171891 3183 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:28.172083 3192 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.162531 30480 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:58:28.171583 3000 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.172526 3183 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.142386 3153 consensus_queue.cc:1059] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260807 07:58:28.174878 3183 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.175639 2946 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:28.176064 2946 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:28.176410 2946 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:28.147949 31377 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:28.159982 3168 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:28.183202 3168 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:28.135946 3189 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.148200 3148 raft_consensus.cc:2804] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:58:28.182296 3139 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.185253 3142 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.185964 3153 raft_consensus.cc:3055] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:28.185107 3189 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:28.188279 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.164673 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:28.191118 2794 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:28.152910 3173 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:28.193240 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.195053 30429 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:28.195252 30479 raft_consensus.cc:3060] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:28.198166 2846 raft_consensus.cc:2804] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:28.199442 2846 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.199834 2846 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:28.200429 30429 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:28.202340 30490 raft_consensus.cc:2393] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 6: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:28.176545 3000 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.195675 3190 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:28.190234 3148 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.210394 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.212602 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.194283 3153 raft_consensus.cc:740] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:28.206954 30430 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:28.150884 3191 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.221633 3191 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:28.222329 3189 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:28.222517 3145 raft_consensus.cc:2804] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:58:28.223099 3194 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.222936 3189 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.223152 3183 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.224545 3183 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.193806 3184 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.222930 3145 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.216466 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:28.217459 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.223713 3194 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.156983 3188 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.203387 3135 raft_consensus.cc:2804] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:28.188334 3178 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.225605 3145 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:28.255888 3188 leader_election.cc:290] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.213557 3148 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:28.230499 30317 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:28.231170 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.257507 30358 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 9.
I20260807 07:58:28.257777 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.236549 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.237272 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.237707 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.237963 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.259394 30363 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 3.
I20260807 07:58:28.238399 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.238657 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.239777 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.242969 2846 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.244503 3184 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:28.244915 3139 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.245772 3153 consensus_queue.cc:260] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.246717 3194 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.272961 3153 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:28.275559 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.247330 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.248692 3190 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.225041 3189 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:28.281543 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 81182us
I20260807 07:58:28.254236 2946 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.254925 30219 catalog_manager.cc:5697] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 8 to 9, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 9 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:28.232795 2794 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:28.261351 30479 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:58:28.258905 30373 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 6.
I20260807 07:58:28.258400 30588 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 10.
I20260807 07:58:28.270957 3139 raft_consensus.cc:2804] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:28.278468 2846 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:28.283483 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:28.293411 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.294200 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:28.294831 30367 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:28.268256 3188 raft_consensus.cc:2804] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:58:28.296507 30317 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:28.254117 3172 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.268700 3135 raft_consensus.cc:697] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:28.300661 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:28.305970 3179 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:28.330149 3179 raft_consensus.cc:697] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:28.331063 3179 consensus_queue.cc:237] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.338475 3178 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:28.301697 3139 raft_consensus.cc:697] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:28.343180 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:28.343029 3139 consensus_queue.cc:237] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.346705 3172 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 12 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:28.298094 3188 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.347630 3188 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:28.394984 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.395081 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.396757 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.400763 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:58:28.405786 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 198973us
I20260807 07:58:28.414882 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:28.415086 30490 raft_consensus.cc:1240] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:28.415723 30476 raft_consensus.cc:1240] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 9. Current term is 10. Ops: []
I20260807 07:58:28.415457 31372 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:28.419288 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.430226 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.430770 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.433205 3174 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.398769 3135 consensus_queue.cc:237] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.601969 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.607879 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.591835 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.440482 30477 raft_consensus.cc:1240] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 3. Current term is 4. Ops: []
W20260807 07:58:28.451092 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 139355us
I20260807 07:58:28.450242 31372 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:28.554960 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.593803 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.438805 30476 raft_consensus.cc:1240] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:28.497625 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:28.579704 30367 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:28.555218 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:28.593886 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.593986 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.634472 31338 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:28.556294 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.589668 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.496557 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:28.592929 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.469122 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.594064 3145 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.637279 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.643155 30430 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:28.554994 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:28.644699 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.496923 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.590998 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.594502 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.535380 30539 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:28.597981 31377 raft_consensus.cc:1240] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:28.486678 3190 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.533524 2946 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:28.646624 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 111336us
I20260807 07:58:28.646914 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.647126 30585 raft_consensus.cc:2393] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 4: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:28.650892 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.468343 3142 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:28.657361 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 101585us
I20260807 07:58:28.653941 30478 raft_consensus.cc:1240] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:28.655325 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.485999 3183 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.657157 30539 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:28.658814 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.662253 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.488221 3160 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.485131 3148 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.562556 3188 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.592221 3173 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.663765 3133 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260807 07:58:28.664646 3172 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 07:58:28.646320 3198 raft_consensus.cc:2804] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:28.671705 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:28.664495 30366 raft_consensus.cc:1240] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:28.486550 3180 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.490727 3182 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.690912 3182 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:28.692055 30588 raft_consensus.cc:2393] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 8: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
W20260807 07:58:28.691344 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:28.693869 30588 raft_consensus.cc:1240] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:28.694757 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:28.695268 3180 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.697978 30429 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:28.694797 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.673982 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:28.675092 30587 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:28.677276 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.678331 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.679443 30539 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:28.679888 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.680490 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.680946 31376 raft_consensus.cc:1240] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:28.682652 31378 raft_consensus.cc:1240] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:28.683223 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:28.683748 3142 consensus_queue.cc:1059] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:28.684062 31384 raft_consensus.cc:1240] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 8. Current term is 9. Ops: []
I20260807 07:58:28.681594 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.685777 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:28.677507 3172 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:28.729538 3172 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:28.688535 3198 raft_consensus.cc:697] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:28.689339 30488 raft_consensus.cc:1240] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:58:28.488780 3168 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.691396 30586 raft_consensus.cc:1240] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:28.682834 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:28.662761 3153 raft_consensus.cc:2764] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260807 07:58:28.677634 3156 consensus_meta.cc:287] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.581s user 0.016s sys 0.012s
I20260807 07:58:28.725045 30489 raft_consensus.cc:1240] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:58:28.728467 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:28.728650 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:28.728984 3173 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:28.726276 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:28.720702 3180 raft_consensus.cc:2804] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:28.777933 30539 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:28.720714 3196 raft_consensus.cc:2749] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 07:58:28.777493 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 74871.1us
I20260807 07:58:28.749804 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:28.778841 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:28.779415 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:28.845800 30487 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:28.849012 31382 raft_consensus.cc:1240] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6. Ops: []
W20260807 07:58:28.847108 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 69266us
I20260807 07:58:28.855314 30539 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:28.724681 3148 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:28.847779 3182 raft_consensus.cc:2749] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:28.859432 30429 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:28.860528 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:28.748492 3145 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:28.807215 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:28.865816 3182 consensus_queue.cc:1059] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:28.785578 3156 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.866614 3174 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:28.859172 3183 consensus_queue.cc:1059] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260807 07:58:28.867583 3160 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 13 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:28.868103 3160 raft_consensus.cc:3055] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Stepping down as leader of term 9
I20260807 07:58:28.868458 3160 raft_consensus.cc:740] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:28.869065 30584 raft_consensus.cc:2393] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 9: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:28.853832 3180 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:28.869710 3180 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:28.870230 30478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:28.870893 30478 raft_consensus.cc:606] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:28.872092 3156 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.861967 3155 raft_consensus.cc:2804] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:58:28.863943 30429 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:28.876020 30429 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:28.876770 30478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:28.878114 30478 raft_consensus.cc:606] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
I20260807 07:58:28.890237 30429 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:28.748653 3198 consensus_queue.cc:237] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.891901 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:28.893304 30429 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:28.894254 3139 raft_consensus.cc:3055] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:28.894646 3139 raft_consensus.cc:740] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:28.895396 3139 consensus_queue.cc:260] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:28.896566 3139 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:28.897945 30478 raft_consensus.cc:1240] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 8. Current term is 9. Ops: []
I20260807 07:58:28.898276 3194 consensus_queue.cc:1059] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:28.900839 31338 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters: f831a53ec51d452398015797d543164e
I20260807 07:58:28.889803 3179 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.901785 3179 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.902053 31338 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters: f831a53ec51d452398015797d543164e
I20260807 07:58:28.892798 3145 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:28.903333 3145 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:28.903537 3133 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 07:58:28.903842 3179 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:28.904199 3168 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:28.904349 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.904712 3201 raft_consensus.cc:2804] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:58:28.905138 3201 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.882582 3155 raft_consensus.cc:697] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:28.906692 30581 raft_consensus.cc:1240] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:28.906296 30579 raft_consensus.cc:1240] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 11. Current term is 12. Ops: []
I20260807 07:58:28.906301 3155 consensus_queue.cc:237] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.901000 3189 raft_consensus.cc:3055] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:28.876614 3196 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260807 07:58:28.881760 3174 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260807 07:58:28.898386 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:28.905534 3201 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:28.933650 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.935037 30476 raft_consensus.cc:2393] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:28.937587 3174 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:28.933112 3196 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:28.901190 3190 raft_consensus.cc:3055] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:28.930550 3148 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:28.903941 3133 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:28.869299 3160 consensus_queue.cc:260] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:28.930400 3145 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:28.931578 3173 raft_consensus.cc:2749] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:28.954660 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.933106 3188 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:28.962483 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.946532 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:28.934500 3189 raft_consensus.cc:740] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
W20260807 07:58:28.947177 3167 consensus_meta.cc:287] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.757s user 0.017s sys 0.000s
W20260807 07:58:28.962092 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 57963.5us
W20260807 07:58:28.961264 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 63875.4us
I20260807 07:58:28.965807 31338 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:28.967036 31338 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:28.955441 3148 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:28.959336 3133 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:28.946506 3196 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Advancing to term 12
I20260807 07:58:28.970616 31338 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:28.964980 31377 raft_consensus.cc:1240] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:28.971292 3186 raft_consensus.cc:2749] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:28.973766 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:28.974426 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:28.976003 30323 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:28.946676 3190 raft_consensus.cc:740] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:28.946974 3174 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Advancing to term 13
I20260807 07:58:29.005625 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:58:28.981158 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:28.984669 30358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
mode: GRACEFUL
new_leader_uuid: "f831a53ec51d452398015797d543164e"
from {username='slave'} at 127.0.0.1:34764
I20260807 07:58:29.010185 3189 consensus_queue.cc:260] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.011287 3189 raft_consensus.cc:3060] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:29.014467 3172 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.015496 30588 raft_consensus.cc:1240] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 10. Current term is 11. Ops: []
I20260807 07:58:29.016501 3172 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:28.969913 3160 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:28.980249 30317 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:29.020430 3184 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:28.992129 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:28.992660 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.993736 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.994415 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.993322 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.995143 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.999819 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:29.000591 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:28.959041 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:28.980931 3148 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:29.037065 30360 raft_consensus.cc:3055] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:58:29.037446 30360 raft_consensus.cc:740] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:29.038148 30360 consensus_queue.cc:260] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.039011 30360 raft_consensus.cc:3060] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:28.987461 2946 raft_consensus.cc:2749] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:29.033833 30590 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:28.982229 3188 consensus_queue.cc:1059] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260807 07:58:29.042008 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.042609 3188 raft_consensus.cc:3055] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:58:29.042970 3188 raft_consensus.cc:740] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:29.043081 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.044418 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.044140 3188 consensus_queue.cc:260] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.020680 3201 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.045589 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.045732 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:29.046336 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:29.046589 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:29.064525 30579 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:29.046900 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:29.048066 30581 raft_consensus.cc:1240] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 8. Current term is 9. Ops: []
I20260807 07:58:29.010680 30358 raft_consensus.cc:606] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Received request to transfer leadership to TS f831a53ec51d452398015797d543164e
W20260807 07:58:29.049115 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 73262.2us
I20260807 07:58:29.050526 30585 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 10.
I20260807 07:58:29.069118 30323 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:29.046051 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:29.062954 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:58:29.074084 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 103521us
I20260807 07:58:29.075186 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:29.023262 30221 catalog_manager.cc:5697] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 6 to 7, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 7 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
W20260807 07:58:29.078128 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 144668us
W20260807 07:58:29.062180 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 81980.4us
I20260807 07:58:29.081488 30578 raft_consensus.cc:1240] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 13 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 12. Current term is 13. Ops: []
I20260807 07:58:29.036607 3174 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.083606 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:29.085212 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:29.063002 3194 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:29.079882 30429 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:29.089119 30429 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:29.071058 3211 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:29.092543 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:29.083187 3188 raft_consensus.cc:3060] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:29.082814 3183 raft_consensus.cc:2749] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 07:58:29.096637 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 188679us
I20260807 07:58:29.027768 3180 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.094426 31338 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:29.033644 3196 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.108127 3190 consensus_queue.cc:260] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.121186 3190 raft_consensus.cc:3060] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:29.122331 3196 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 12 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:29.108644 3180 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:29.124171 30487 raft_consensus.cc:1240] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 11. Current term is 12. Ops: []
I20260807 07:58:29.109710 3197 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:29.104780 27906 auto_leader_rebalancer.cc:474] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260807 07:58:29.106967 30360 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:58:29.074056 3179 consensus_queue.cc:1059] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260807 07:58:29.092104 3198 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:29.070353 3133 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:29.110677 30320 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.64.131:33207 timed out after 1.875s (SENT)
I20260807 07:58:29.109287 3201 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:29.102159 3148 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.125147 30488 raft_consensus.cc:1240] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 8. Current term is 9. Ops: []
I20260807 07:58:29.132181 30541 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:29.127215 27906 auto_leader_rebalancer.cc:844] All tables' leader rebalancing finished this round
W20260807 07:58:29.130995 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 237810us
I20260807 07:58:29.134132 30476 raft_consensus.cc:1240] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 9. Current term is 10. Ops: []
I20260807 07:58:29.135129 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:29.136672 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:29.121290 3191 consensus_queue.cc:1059] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260807 07:58:29.137506 30490 raft_consensus.cc:1240] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 4. Current term is 5. Ops: []
I20260807 07:58:29.138121 30477 raft_consensus.cc:1240] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:29.139022 3194 raft_consensus.cc:3055] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:29.139457 3194 raft_consensus.cc:740] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
W20260807 07:58:29.139911 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 44568.9us
I20260807 07:58:29.140375 3194 consensus_queue.cc:260] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.141611 30429 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:29.130240 2946 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:29.142385 3142 raft_consensus.cc:2804] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:29.142812 3142 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:29.143181 3142 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:29.143093 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:29.147112 3209 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260807 07:58:29.150179 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 65065.6us
I20260807 07:58:29.151859 31376 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 07:58:29.151952 30541 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:29.152900 3209 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:29.153226 30541 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:29.153501 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:29.154233 3182 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:29.154874 30541 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:29.155097 30429 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:29.156668 30429 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:29.158450 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:29.159382 30541 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:29.160008 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:29.161419 31338 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters: f831a53ec51d452398015797d543164e
I20260807 07:58:29.173527 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:29.125603 3197 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:29.175026 30476 raft_consensus.cc:1240] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:29.172628 30429 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:29.179370 2846 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 07:58:29.179719 2846 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:29.178275 31380 raft_consensus.cc:1240] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:58:29.180050 2846 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:29.177543 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:29.176391 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:29.180312 30429 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:29.179860 30541 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
W20260807 07:58:29.178484 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 84356.3us
I20260807 07:58:29.129998 3198 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:29.186029 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:29.186053 30429 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:29.188081 30429 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:29.187548 30587 consensus_queue.cc:237] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:29.155970 3231 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 07:58:29.190405 30317 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:29.193801 30582 raft_consensus.cc:1240] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 3. Current term is 4. Ops: []
W20260807 07:58:29.193974 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:29.195250 3233 raft_consensus.cc:2749] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260807 07:58:29.178258 3168 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:29.175473 3209 raft_consensus.cc:2749] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260807 07:58:29.197292 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 103054us
I20260807 07:58:29.182987 3197 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:29.214715 31338 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:29.188050 3198 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:29.251454 31338 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:29.189291 3156 raft_consensus.cc:2749] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:29.193542 3229 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:29.263785 2846 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:29.264668 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 69133us
I20260807 07:58:29.265753 2846 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:29.193287 3173 raft_consensus.cc:2749] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:29.242491 3133 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:29.289778 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 56253.2us
I20260807 07:58:29.196746 3172 consensus_queue.cc:1059] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260807 07:58:29.196010 3180 consensus_queue.cc:1059] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260807 07:58:29.196606 3153 consensus_queue.cc:1059] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260807 07:58:29.272786 3229 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:29.272955 3233 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:29.272298 3186 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 07:58:29.294930 30539 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:29.209726 3135 consensus_queue.cc:1059] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260807 07:58:29.203190 3206 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260807 07:58:29.279110 3209 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 07:58:29.298502 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 110475us
I20260807 07:58:29.298938 30489 raft_consensus.cc:1240] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 13 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 12. Current term is 13. Ops: []
I20260807 07:58:29.291733 3145 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.311882 3145 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:29.314949 30219 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53656 (request call id 422) took 1129 ms. Trace:
I20260807 07:58:29.293288 3174 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 13 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:29.278648 3213 raft_consensus.cc:2749] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:29.302393 30477 raft_consensus.cc:1240] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:29.305562 30429 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:29.300045 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:29.297511 3229 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:29.292608 3156 consensus_queue.cc:1059] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260807 07:58:29.364624 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:29.294535 3179 consensus_queue.cc:1059] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260807 07:58:29.373965 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 70643.7us
W20260807 07:58:29.380942 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 75447.3us
I20260807 07:58:29.382855 30429 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:29.383795 30429 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:29.295786 3142 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:29.422626 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:29.417793 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.417186 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.420260 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.421368 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.291157 3237 consensus_queue.cc:1059] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
W20260807 07:58:29.422384 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:29.426580 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.386776 3233 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:29.406019 3172 raft_consensus.cc:3055] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:58:29.406257 3145 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:29.315316 30219 rpcz_store.cc:276] 0807 07:58:28.185777 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:28.185930 (+ 153us) service_pool.cc:224] Handling call
0807 07:58:29.314864 (+1128934us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:58:28.684735 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:58:28.685426 (+ 691us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:58:28.685490 (+ 64us) write_op.cc:435] Acquired schema lock
0807 07:58:28.685521 (+ 31us) tablet.cc:662] Decoding operations
0807 07:58:28.685899 (+ 378us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:58:28.686006 (+ 107us) write_op.cc:641] Partition lock acquired for write op
0807 07:58:28.686031 (+ 25us) tablet.cc:685] Acquiring locks for 1 operations
0807 07:58:28.686396 (+ 365us) tablet.cc:701] Row locks acquired
0807 07:58:28.686425 (+ 29us) write_op.cc:260] PREPARE: finished
0807 07:58:28.686601 (+ 176us) write_op.cc:270] Start()
0807 07:58:28.686745 (+ 144us) write_op.cc:276] Timestamp: P: 1786089508686539 usec, L: 0
0807 07:58:28.686792 (+ 47us) op_driver.cc:348] REPLICATION: starting
0807 07:58:28.687552 (+ 760us) log.cc:844] Serialized 536 byte log entry
0807 07:58:28.935985 (+248433us) op_driver.cc:464] REPLICATION: finished
0807 07:58:29.129553 (+193568us) write_op.cc:301] APPLY: starting
0807 07:58:29.135908 (+ 6355us) tablet.cc:1367] starting BulkCheckPresence
0807 07:58:29.189254 (+ 53346us) tablet.cc:1370] finished BulkCheckPresence
0807 07:58:29.233729 (+ 44475us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:58:29.234119 (+ 390us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:58:29.234454 (+ 335us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 07:58:29.234519 (+ 65us) write_op.cc:312] APPLY: finished
0807 07:58:29.234865 (+ 346us) log.cc:844] Serialized 23 byte log entry
0807 07:58:29.235151 (+ 286us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:29.235244 (+ 93us) write_op.cc:454] Released schema lock
0807 07:58:29.235316 (+ 72us) write_op.cc:341] FINISH: Updating metrics
0807 07:58:29.235856 (+ 540us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:29.235880 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":157036,"apply.run_cpu_time_us":2820,"apply.run_wall_time_us":135914,"num_ops":1,"prepare.queue_time_us":251864,"prepare.run_cpu_time_us":12962,"prepare.run_wall_time_us":104785,"raft.queue_time_us":35515,"raft.run_cpu_time_us":73030,"raft.run_wall_time_us":175102,"replication_time_us":249008,"thread_start_us":339924,"threads_started":4,"wal-append.queue_time_us":171362}]]}
I20260807 07:58:29.428539 30366 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260807 07:58:29.407955 3209 raft_consensus.cc:3055] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:58:29.434006 30490 raft_consensus.cc:1240] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 6. Current term is 7. Ops: []
I20260807 07:58:29.429817 31338 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
W20260807 07:58:29.430852 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 251049us
I20260807 07:58:29.450266 30541 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
W20260807 07:58:29.430579 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 135726us
I20260807 07:58:29.429504 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.439177 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.439592 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.430150 3148 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:29.454361 30319 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:29.457212 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.457504 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.460065 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:29.461956 3265 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:29.462100 30488 raft_consensus.cc:1275] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:58:29.463219 31338 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
W20260807 07:58:29.464655 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 81759.1us
I20260807 07:58:29.465360 30320 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:29.469306 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.469923 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.479691 30320 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:29.435158 3172 raft_consensus.cc:740] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:29.470409 3255 raft_consensus.cc:2749] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 07:58:29.470918 31378 raft_consensus.cc:1240] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:29.471366 31377 raft_consensus.cc:1240] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 9. Current term is 10. Ops: []
I20260807 07:58:29.431694 3135 consensus_queue.cc:1059] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260807 07:58:29.475952 3160 raft_consensus.cc:2749] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 07:58:29.469847 3142 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:29.478411 3271 consensus_queue.cc:1059] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 07:58:29.470080 3266 raft_consensus.cc:3055] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Stepping down as leader of term 9
I20260807 07:58:29.469105 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:29.431406 3251 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:29.469065 3145 raft_consensus.cc:697] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:29.483384 30429 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:58:29.485173 30541 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:29.448776 3209 raft_consensus.cc:740] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
W20260807 07:58:29.488744 30319 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:29.428920 3244 consensus_queue.cc:1059] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260807 07:58:29.495151 30477 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:58:29.485617 30320 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:29.495458 30541 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:29.496460 3142 raft_consensus.cc:2804] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:29.510936 3142 raft_consensus.cc:697] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:29.492100 3194 raft_consensus.cc:3060] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:29.514856 30488 raft_consensus.cc:1240] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
I20260807 07:58:29.515102 3252 raft_consensus.cc:2749] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:29.511797 3142 consensus_queue.cc:237] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.490954 3135 raft_consensus.cc:3055] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:29.514536 30429 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:29.492486 3211 raft_consensus.cc:3055] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:29.493338 3145 consensus_queue.cc:237] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.523478 3211 raft_consensus.cc:740] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:29.524382 3211 consensus_queue.cc:260] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.525147 3133 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:29.491664 3182 raft_consensus.cc:2749] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:58:29.489966 3232 raft_consensus.cc:3055] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:58:29.529441 3232 raft_consensus.cc:740] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:29.529874 3267 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:29.522398 31382 raft_consensus.cc:1275] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260807 07:58:29.468245 3183 consensus_queue.cc:1059] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260807 07:58:29.525616 3264 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 07:58:29.368646 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:29.491703 3266 raft_consensus.cc:740] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:29.492460 3251 raft_consensus.cc:697] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:58:29.533145 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 43905.9us
I20260807 07:58:29.538266 3183 raft_consensus.cc:3055] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:29.538030 3172 consensus_queue.cc:260] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.538683 3183 raft_consensus.cc:740] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:29.539515 3183 consensus_queue.cc:260] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.530681 3173 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 07:58:29.498291 3209 consensus_queue.cc:260] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.542253 3209 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:29.542116 3266 consensus_queue.cc:260] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.543540 3266 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:29.537890 3251 consensus_queue.cc:237] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.529812 31378 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 07:58:29.525616 3211 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:29.522938 3135 raft_consensus.cc:740] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:29.554420 3206 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 07:58:29.556878 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
W20260807 07:58:29.555413 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 128985us
I20260807 07:58:29.549835 3155 raft_consensus.cc:2749] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:29.539526 3172 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:29.559128 3272 raft_consensus.cc:2749] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:29.559485 31338 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:29.561635 31338 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:29.565167 30367 raft_consensus.cc:1275] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 07:58:29.566326 3269 raft_consensus.cc:2749] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:58:29.560571 3255 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260807 07:58:29.541030 3252 consensus_queue.cc:1048] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260807 07:58:29.569597 30320 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:29.573768 30363 raft_consensus.cc:1275] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 07:58:29.575676 3271 consensus_queue.cc:1059] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:29.576669 3264 raft_consensus.cc:3055] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Stepping down as leader of term 6
W20260807 07:58:29.577037 30542 consensus_peers.cc:597] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8f2551f38a348389729e12d49142027. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:58:29.577046 3264 raft_consensus.cc:740] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:29.532323 3198 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.530536 3197 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.564078 3173 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:29.588163 30320 leader_election.cc:304] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:29.587088 3271 consensus_queue.cc:1059] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260807 07:58:29.589522 3168 raft_consensus.cc:993] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:29.589977 3168 raft_consensus.cc:1081] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:29.588039 30489 raft_consensus.cc:1240] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:29.552582 3267 consensus_queue.cc:1059] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260807 07:58:29.583437 3179 raft_consensus.cc:2749] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:29.593780 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.594836 30320 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:29.596369 30369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:29.596994 30369 raft_consensus.cc:493] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:29.598621 30222 catalog_manager.cc:5697] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 7 to 8, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 8 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:29.605852 3153 raft_consensus.cc:3055] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:58:29.606232 3153 raft_consensus.cc:740] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:29.606971 3153 consensus_queue.cc:260] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.607831 3243 raft_consensus.cc:3055] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 11 LEADER]: Stepping down as leader of term 11
I20260807 07:58:29.608232 3243 raft_consensus.cc:740] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:29.594046 3139 consensus_queue.cc:1048] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260807 07:58:29.597283 30369 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:29.533526 3232 consensus_queue.cc:260] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.593044 3198 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:29.609066 3243 consensus_queue.cc:260] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.586673 3173 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.578150 3135 consensus_queue.cc:260] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.596560 3190 raft_consensus.cc:2749] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260807 07:58:29.619827 3199 consensus_queue.cc:1048] T d30d61dc67614c5c9d0f1083e2a463b9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 07:58:29.623071 30490 raft_consensus.cc:1240] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 10. Current term is 11. Ops: []
I20260807 07:58:29.610817 3271 raft_consensus.cc:2749] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:29.586634 3272 consensus_queue.cc:1059] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260807 07:58:29.633339 30477 raft_consensus.cc:1240] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 6. Current term is 7. Ops: []
W20260807 07:58:29.649111 31338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:29.647092 30369 raft_consensus.cc:515] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.656824 3156 raft_consensus.cc:3055] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Stepping down as leader of term 4
I20260807 07:58:29.657352 3156 raft_consensus.cc:740] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:29.632879 3273 raft_consensus.cc:3055] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:29.663770 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:29.673161 3190 consensus_queue.cc:1059] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260807 07:58:29.675334 30478 raft_consensus.cc:3055] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:29.651889 3135 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:29.680035 30478 raft_consensus.cc:740] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
W20260807 07:58:29.698868 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 203463us
I20260807 07:58:29.700093 30541 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:29.676637 3243 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Advancing to term 12
I20260807 07:58:29.707526 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.674624 3273 raft_consensus.cc:740] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:29.704639 30478 consensus_queue.cc:260] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.674373 3272 consensus_queue.cc:1059] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260807 07:58:29.714205 30541 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:29.717155 30478 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:29.721108 3244 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:29.721921 3244 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.722517 3188 raft_consensus.cc:3055] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 12 LEADER]: Stepping down as leader of term 12
I20260807 07:58:29.723063 3188 raft_consensus.cc:740] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:29.699697 3252 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:29.685387 3274 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:29.728915 3188 consensus_queue.cc:260] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.730340 3244 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:29.650902 3264 consensus_queue.cc:260] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.673035 3230 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260807 07:58:29.740500 30487 raft_consensus.cc:1240] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6. Ops: []
W20260807 07:58:29.742702 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 147914us
I20260807 07:58:29.743137 30587 raft_consensus.cc:1240] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:29.744042 30320 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:29.745741 30480 raft_consensus.cc:1240] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 6. Current term is 7. Ops: []
I20260807 07:58:29.743796 2846 consensus_queue.cc:1048] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:29.747023 30320 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:29.748260 3277 raft_consensus.cc:2749] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:29.749933 30482 raft_consensus.cc:1275] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:58:29.754277 30479 raft_consensus.cc:1240] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 4. Current term is 5. Ops: []
I20260807 07:58:29.754544 3179 raft_consensus.cc:2749] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:29.755209 3250 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:29.757328 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:29.757979 30488 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:58:29.759397 3264 raft_consensus.cc:3060] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:29.693861 3156 consensus_queue.cc:260] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.779443 3153 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
W20260807 07:58:29.784761 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:29.793691 30539 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:29.721045 3273 consensus_queue.cc:260] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.796720 3272 consensus_queue.cc:1059] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260807 07:58:29.797705 3237 consensus_queue.cc:1048] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260807 07:58:29.799517 3283 log.cc:927] Time spent T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260807 07:58:29.782788 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:29.799674 3237 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:29.818156 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.790793 3188 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 12 FOLLOWER]: Advancing to term 13
W20260807 07:58:29.828640 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:29.803977 3156 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
W20260807 07:58:29.834308 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:29.795962 3179 consensus_queue.cc:1059] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260807 07:58:29.743568 3274 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.820264 3237 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:29.805639 3182 consensus_queue.cc:1059] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260807 07:58:29.740576 3252 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.848371 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:29.848876 31372 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:58:29.850672 3269 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:29.836223 3273 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:29.850349 3272 raft_consensus.cc:3055] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:29.849756 30430 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:29.858242 31378 raft_consensus.cc:2393] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 8: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:58:29.843652 3237 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:29.832581 3229 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.847044 3173 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:29.881448 30478 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:58:29.881654 30369 leader_election.cc:290] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:29.862998 3272 raft_consensus.cc:740] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:29.850561 3288 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:29.872131 3182 consensus_queue.cc:1243] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [LEADER]: Peer ef1ca7acf52a438f89f14707e9e06818 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260807 07:58:29.873528 3206 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260807 07:58:29.894246 3280 log.cc:927] Time spent T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
W20260807 07:58:29.912668 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:58:29.920313 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 180432us
I20260807 07:58:29.923767 30320 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:29.935048 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:29.891388 3233 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260807 07:58:29.941099 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:29.851234 3269 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:29.902330 3206 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:29.885619 3276 raft_consensus.cc:2749] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260807 07:58:29.938591 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 135459us
I20260807 07:58:29.949991 31372 raft_consensus.cc:1240] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 9. Current term is 10. Ops: []
I20260807 07:58:29.935499 31376 raft_consensus.cc:1240] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 6. Current term is 7. Ops: []
I20260807 07:58:29.952817 30365 raft_consensus.cc:1275] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:58:29.943105 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c3e02cee5d54a65bd61ae2521a9944c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:29.959124 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:29.959437 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:29.946772 3206 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:29.961835 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:29.964911 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:29.965948 3190 raft_consensus.cc:3055] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:29.966341 3190 raft_consensus.cc:740] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:29.967155 3190 consensus_queue.cc:260] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:29.970450 31372 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Advancing to term 6
W20260807 07:58:29.976377 30429 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:29.978937 30429 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:29.979795 3148 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 07:58:29.980300 3148 raft_consensus.cc:697] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 10 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:29.917760 3242 consensus_queue.cc:1059] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.166s
I20260807 07:58:29.964246 31378 raft_consensus.cc:3060] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:30.018656 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:29.963701 3277 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:30.026134 30578 raft_consensus.cc:2393] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 12: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:29.974661 3271 raft_consensus.cc:3055] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 10 LEADER]: Stepping down as leader of term 10
I20260807 07:58:30.027982 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:29.902627 3288 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:30.051666 30540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:30.034337 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:29.977545 3179 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:58:30.068897 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:30.069662 30588 raft_consensus.cc:2393] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 13: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:30.074419 30586 raft_consensus.cc:2393] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 11: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:30.027856 3197 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:29.952486 3272 consensus_queue.cc:260] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:30.033694 3265 consensus_meta.cc:287] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent flushing consensus metadata: real 0.571s user 0.012s sys 0.000s
W20260807 07:58:30.032708 3286 log.cc:927] Time spent T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.169s user 0.000s sys 0.001s
I20260807 07:58:30.079813 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:30.079380 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:58:30.079044 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 99745.6us
I20260807 07:58:30.066785 3271 raft_consensus.cc:740] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:30.080639 3190 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:30.107635 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:30.108245 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:30.084785 3265 raft_consensus.cc:2749] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:30.108198 30317 leader_election.cc:304] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:30.112589 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:58:30.115665 3292 log.cc:927] Time spent T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.168s user 0.000s sys 0.001s
I20260807 07:58:30.079833 3242 consensus_queue.cc:1059] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260807 07:58:30.122447 31372 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:30.089183 3274 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:30.127467 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:30.109668 3272 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:30.032955 3284 consensus_queue.cc:1059] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.148s
W20260807 07:58:30.136322 31338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:30.083341 3148 consensus_queue.cc:237] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:30.111155 3229 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:30.128916 3172 consensus_meta.cc:287] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.570s user 0.009s sys 0.003s
W20260807 07:58:30.129232 3194 consensus_meta.cc:287] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.618s user 0.012s sys 0.000s
I20260807 07:58:30.141708 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:30.141491 3317 raft_consensus.cc:2804] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:30.145298 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:30.146967 3189 raft_consensus.cc:3055] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:30.147397 3189 raft_consensus.cc:740] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:30.147692 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:30.148602 3180 raft_consensus.cc:3055] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Stepping down as leader of term 9
I20260807 07:58:30.148994 3180 raft_consensus.cc:740] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:30.068339 3277 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.148289 3189 consensus_queue.cc:260] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:30.156530 31338 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:30.157171 30360 raft_consensus.cc:1275] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:58:30.160401 3133 raft_consensus.cc:2749] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 07:58:30.160701 30487 raft_consensus.cc:1240] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260807 07:58:30.162626 3133 consensus_queue.cc:1048] T af8f2d95eba240e2965db9be8b951bee P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260807 07:58:30.163223 3209 consensus_meta.cc:287] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.620s user 0.012s sys 0.000s
I20260807 07:58:30.105727 3252 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:30.170501 30587 raft_consensus.cc:2468] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:58:30.164835 3250 raft_consensus.cc:3055] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:30.184216 30584 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:58:30.140404 3288 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:30.189776 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:30.190111 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:30.204594 30586 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 7.
I20260807 07:58:30.167100 3317 raft_consensus.cc:697] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
W20260807 07:58:30.190172 3309 log.cc:927] Time spent T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.076s user 0.000s sys 0.000s
I20260807 07:58:30.176311 3189 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:30.171083 3209 consensus_queue.cc:1059] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260807 07:58:30.212291 30222 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40988 (request call id 200) took 1080 ms. Trace:
I20260807 07:58:30.187615 3269 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:30.181896 3250 raft_consensus.cc:740] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
W20260807 07:58:30.229630 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 292492us
I20260807 07:58:30.228891 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:30.239493 3317 consensus_queue.cc:237] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:30.242000 3303 log.cc:927] Time spent T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.054s user 0.001s sys 0.000s
I20260807 07:58:30.245240 3277 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:30.253602 30582 raft_consensus.cc:2468] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:58:30.261484 30320 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:30.264307 30320 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:30.265090 3188 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:30.265496 30320 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:30.265770 3188 raft_consensus.cc:2749] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:58:30.266625 3188 raft_consensus.cc:2749] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:30.266639 30320 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
W20260807 07:58:30.219424 3211 consensus_meta.cc:287] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.663s user 0.009s sys 0.002s
I20260807 07:58:30.268311 3188 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 07:58:30.216784 3310 log.cc:927] Time spent T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.105s user 0.001s sys 0.000s
I20260807 07:58:30.272722 3297 raft_consensus.cc:3055] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:58:30.265654 3229 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:30.273169 3297 raft_consensus.cc:740] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:30.274103 3297 consensus_queue.cc:260] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.229779 30222 rpcz_store.cc:276] 0807 07:58:29.131443 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:29.136871 (+ 5428us) service_pool.cc:224] Handling call
0807 07:58:29.474493 (+337622us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54002a1a54. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b5260470 00007fd6b52ff31a 00007fd6bb0ef38c 00007fd6bb1ebbfe 00007fd6b96a54a4 00007fd6b96a5432 00007fd6b96a5361 00007fd6b96a52dc 00007fd6b96a4592 00007fd6b363007c 00007fd6b362f4b6
0807 07:58:30.212213 (+737720us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:58:29.607465 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:58:29.607974 (+ 509us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:58:29.608009 (+ 35us) write_op.cc:435] Acquired schema lock
0807 07:58:29.608024 (+ 15us) tablet.cc:662] Decoding operations
0807 07:58:29.608350 (+ 326us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:58:29.608401 (+ 51us) write_op.cc:641] Partition lock acquired for write op
0807 07:58:29.608426 (+ 25us) tablet.cc:685] Acquiring locks for 1 operations
0807 07:58:29.608627 (+ 201us) tablet.cc:701] Row locks acquired
0807 07:58:29.608646 (+ 19us) write_op.cc:260] PREPARE: finished
0807 07:58:29.608780 (+ 134us) write_op.cc:270] Start()
0807 07:58:29.608882 (+ 102us) write_op.cc:276] Timestamp: P: 1786089509608735 usec, L: 0
0807 07:58:29.608902 (+ 20us) op_driver.cc:348] REPLICATION: starting
0807 07:58:29.609508 (+ 606us) log.cc:844] Serialized 536 byte log entry
0807 07:58:29.623528 (+ 14020us) op_driver.cc:464] REPLICATION: finished
0807 07:58:29.633262 (+ 9734us) write_op.cc:301] APPLY: starting
0807 07:58:29.633351 (+ 89us) tablet.cc:1367] starting BulkCheckPresence
0807 07:58:29.633533 (+ 182us) tablet.cc:1370] finished BulkCheckPresence
0807 07:58:29.658994 (+ 25461us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:58:29.659376 (+ 382us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:58:29.659682 (+ 306us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 07:58:29.659784 (+ 102us) write_op.cc:312] APPLY: finished
0807 07:58:29.660049 (+ 265us) log.cc:844] Serialized 23 byte log entry
0807 07:58:29.660259 (+ 210us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:29.660376 (+ 117us) write_op.cc:454] Released schema lock
0807 07:58:29.660415 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0807 07:58:29.660984 (+ 569us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:29.661020 (+ 36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52268,"reported_tablets":1,"spinlock_wait_cycles":281352576,"child_traces":[["op",{"apply.queue_time_us":193,"apply.run_cpu_time_us":2907,"apply.run_wall_time_us":27627,"num_ops":1,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":2305,"prepare.run_wall_time_us":2321,"replication_time_us":14502}]]}
I20260807 07:58:30.275651 3229 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.276363 30581 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:30.277724 30320 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:30.278878 30320 leader_election.cc:304] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:30.279085 30588 raft_consensus.cc:1275] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:58:30.279531 30541 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.280051 3189 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:30.298645 3183 raft_consensus.cc:3060] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:30.280630 30541 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:30.317363 30541 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.319303 30541 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.279949 30320 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:30.282047 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:30.286376 3321 raft_consensus.cc:2749] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:30.287020 3266 raft_consensus.cc:2749] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260807 07:58:30.335922 30579 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 5.
I20260807 07:58:30.337152 30541 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.339550 30587 raft_consensus.cc:2376] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7. Re-sending same reply.
W20260807 07:58:30.384182 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 104287us
W20260807 07:58:30.391350 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 54291.1us
W20260807 07:58:30.320212 3264 consensus_meta.cc:287] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.523s user 0.003s sys 0.009s
I20260807 07:58:30.392647 30541 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
W20260807 07:58:30.393303 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 82983.5us
W20260807 07:58:30.394658 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:58:30.398166 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:30.282153 3209 consensus_queue.cc:1243] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [LEADER]: Peer ef1ca7acf52a438f89f14707e9e06818 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260807 07:58:30.403962 30366 raft_consensus.cc:1240] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 3. Current term is 4. Ops: []
W20260807 07:58:30.407653 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260807 07:58:30.408018 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:30.384578 3155 raft_consensus.cc:2749] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 07:58:30.335623 3160 raft_consensus.cc:2749] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:30.410151 30541 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.389423 3156 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 07:58:30.408632 31338 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.392244 3167 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260807 07:58:30.411830 3199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s user 0.098s sys 0.067s
I20260807 07:58:30.393522 3211 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:30.221061 3237 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.424696 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:30.186017 3271 consensus_queue.cc:260] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:30.425338 30541 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.422705 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:30.430884 30369 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:58:30.419421 3268 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:30.417946 3229 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:30.422662 3201 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260807 07:58:30.442826 3243 consensus_meta.cc:287] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.735s user 0.009s sys 0.003s
I20260807 07:58:30.428144 3155 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260807 07:58:30.452554 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 44726.1us
W20260807 07:58:30.424503 3199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s user 0.098s sys 0.068s
I20260807 07:58:30.462272 30541 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.464811 3328 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260807 07:58:30.448488 3250 consensus_queue.cc:260] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:30.466867 3250 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:30.464843 30541 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.449127 3201 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:30.448493 31378 raft_consensus.cc:2468] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:58:30.469017 3160 raft_consensus.cc:2749] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:30.474993 30541 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.471961 3155 raft_consensus.cc:2749] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 07:58:30.483263 3244 raft_consensus.cc:2749] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260807 07:58:30.489423 30478 raft_consensus.cc:1240] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:30.489729 30487 raft_consensus.cc:1240] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:30.470765 3201 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:30.495755 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:30.496526 30476 raft_consensus.cc:2393] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:30.496990 3244 consensus_queue.cc:1048] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260807 07:58:30.493070 3206 consensus_meta.cc:287] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818: Time spent flushing consensus metadata: real 0.519s user 0.011s sys 0.001s
I20260807 07:58:30.506426 3295 raft_consensus.cc:3055] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:30.506870 3295 raft_consensus.cc:740] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:30.507368 30221 catalog_manager.cc:5697] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e reported cstate change: term changed from 3 to 4, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to f831a53ec51d452398015797d543164e (127.27.64.131). New cstate: current_term: 4 leader_uuid: "f831a53ec51d452398015797d543164e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: HEALTHY } } }
I20260807 07:58:30.514369 30219 catalog_manager.cc:5697] T 5cb72552d8da48b78c58110bb0c84f61 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 7 to 8, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 8 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:30.516124 30219 catalog_manager.cc:5697] T e6f61d2b65b04216b54f6a2f8deadd0a P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 5 to 6, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:30.530405 30358 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:30.533179 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:30.548223 30490 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:58:30.550873 3297 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:30.507658 3295 consensus_queue.cc:260] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:30.555550 30539 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:30.561503 3237 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:30.508880 3206 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.563594 3206 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:30.565716 3232 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:30.566941 31382 raft_consensus.cc:1240] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 9. Current term is 10. Ops: []
I20260807 07:58:30.569530 30477 raft_consensus.cc:2368] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6.
I20260807 07:58:30.573989 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:30.574630 30584 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 6.
I20260807 07:58:30.575786 30320 leader_election.cc:304] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:30.578118 3317 raft_consensus.cc:2749] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:30.579123 30320 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:30.588282 30365 raft_consensus.cc:1240] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:30.587247 3295 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:30.573531 3284 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:30.587013 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:30.568884 3196 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260807 07:58:30.606802 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:30.595630 3242 consensus_queue.cc:1048] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260807 07:58:30.594262 3237 consensus_queue.cc:1059] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260807 07:58:30.590080 3317 raft_consensus.cc:2749] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:58:30.609210 31383 raft_consensus.cc:1240] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 8. Current term is 9. Ops: []
I20260807 07:58:30.611418 31378 raft_consensus.cc:2393] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 5: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:58:30.611641 31377 raft_consensus.cc:2393] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 8: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:58:30.611795 3237 raft_consensus.cc:3055] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Stepping down as leader of term 6
W20260807 07:58:30.613045 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:30.612622 3237 raft_consensus.cc:740] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:30.614100 3237 consensus_queue.cc:260] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.615443 3237 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:30.594233 3180 consensus_queue.cc:260] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.622783 3244 consensus_queue.cc:1059] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260807 07:58:30.624884 30365 raft_consensus.cc:1275] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260807 07:58:30.626291 30317 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:30.627156 30490 raft_consensus.cc:1240] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 6. Current term is 7. Ops: []
I20260807 07:58:30.631178 3201 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.632069 3180 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:30.633984 31382 raft_consensus.cc:1240] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:30.603960 3284 raft_consensus.cc:697] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 8 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:30.634469 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:30.642758 30429 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:30.648772 2846 raft_consensus.cc:2804] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:30.649292 2846 raft_consensus.cc:697] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [term 8 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:30.649531 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:30.650230 31372 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:30.660521 2846 consensus_queue.cc:237] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:30.646341 3201 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:30.667624 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:30.668503 30587 raft_consensus.cc:2393] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 8: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:30.669499 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:30.670142 30590 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 6
I20260807 07:58:30.670779 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:30.674985 3271 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Advancing to term 11
W20260807 07:58:30.677821 3338 log.cc:927] Time spent T 3c1d04e8312f4ddcb5bcfc4160d4e615 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.129s user 0.001s sys 0.000s
I20260807 07:58:30.678093 30586 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:30.678510 30582 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:30.679150 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:30.679450 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:30.680151 30582 raft_consensus.cc:2393] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 10: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:30.681103 30582 raft_consensus.cc:1240] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 10. Current term is 11. Ops: []
I20260807 07:58:30.681903 30578 raft_consensus.cc:1240] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:30.687045 30586 raft_consensus.cc:2393] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 4: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
W20260807 07:58:30.693847 30319 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:30.692466 3142 consensus_queue.cc:1048] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260807 07:58:30.694751 3199 consensus_queue.cc:1059] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 07:58:30.695780 3142 raft_consensus.cc:3055] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:30.696138 3142 raft_consensus.cc:740] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:30.702488 30541 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.704738 31338 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.710752 31372 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:30.720432 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:30.721083 30588 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:30.731702 30320 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:30.736316 30590 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:30.739167 30429 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:30.715777 3313 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:30.773660 3313 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:30.774116 3313 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:30.739046 3284 consensus_queue.cc:237] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.717442 3244 raft_consensus.cc:2804] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:30.746433 3251 raft_consensus.cc:2749] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260807 07:58:30.746739 30429 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:30.748572 30320 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:30.787199 30320 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:30.749029 3253 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:30.696933 3142 consensus_queue.cc:260] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.754539 30579 raft_consensus.cc:1275] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260807 07:58:30.757153 30477 raft_consensus.cc:1275] T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:30.761417 30539 leader_election.cc:400] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6.
I20260807 07:58:30.790110 30539 leader_election.cc:403] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:58:30.789937 30579 pending_rounds.cc:85] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e: Aborting all ops after (but not including) 5
I20260807 07:58:30.792714 3295 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:30.793056 3333 raft_consensus.cc:2749] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260807 07:58:30.790934 30579 pending_rounds.cc:107] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.6
I20260807 07:58:30.792600 3237 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 5. Current term is 6.
I20260807 07:58:30.792532 3142 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
W20260807 07:58:30.796373 3340 log.cc:927] Time spent T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.150s user 0.001s sys 0.000s
I20260807 07:58:30.797577 3244 raft_consensus.cc:697] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [term 7 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:30.798563 3244 consensus_queue.cc:237] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:30.793836 30579 raft_consensus.cc:2917] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Aborting config change with OpId 5.6: Aborted: Op aborted by new leader
I20260807 07:58:30.801987 30579 raft_consensus.cc:2889] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:58:30.802580 30579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42436 (request call id 7) took 1670 ms. Trace:
I20260807 07:58:30.802924 30579 rpcz_store.cc:276] 0807 07:58:29.132333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:29.132634 (+ 301us) service_pool.cc:224] Handling call
0807 07:58:29.245765 (+113131us) log.cc:844] Serialized 506 byte log entry
0807 07:58:29.730860 (+485095us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4c00303880. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b35bffc0 00007fd6b35d0fa9 00007fd6b35d168f 00007fd6b3594e7b 00007fd6b35c34dc 00007fd6b35c399e 00007fd6b385366b 00007fd6b5252761 00007fd6b525064b 00007fd6b5257133 00007fd6b52570b9
0807 07:58:30.115964 (+385104us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b5400379ea0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b526f522 00007fd6b525028a 00007fd6b5257133 00007fd6b52570b9 00007fd6b5257049 00007fd6b5257011 00007fd6b52561dd 00000000003aa554 00000000003aa399 00007fd6b21efdb5
0807 07:58:30.802397 (+686433us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139064,"raft.queue_time_us":221909,"raft.run_cpu_time_us":34282,"raft.run_wall_time_us":905889,"spinlock_wait_cycles":31878784,"thread_start_us":150885,"threads_started":2,"wal-append.queue_time_us":131847,"wal-append.run_cpu_time_us":2140,"wal-append.run_wall_time_us":1112118}
W20260807 07:58:30.806936 30294 auto_rebalancer.cc:644] Failed to schedule move for tablet c8f2551f38a348389729e12d49142027: Aborted: Op aborted by new leader
W20260807 07:58:30.789016 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 50081.7us
I20260807 07:58:30.813709 30430 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:30.790545 3297 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:30.815603 3271 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:30.816190 3206 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:30.816723 3206 raft_consensus.cc:697] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:30.817601 3206 consensus_queue.cc:237] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:30.793234 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 46569.8us
I20260807 07:58:30.834196 30429 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:30.835454 30429 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:30.836191 3199 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260807 07:58:30.836426 30588 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 8.
I20260807 07:58:30.837668 30429 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:30.836894 3199 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 07:58:30.834295 31372 raft_consensus.cc:1275] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260807 07:58:30.849568 3297 consensus_queue.cc:1048] T 1c3e02cee5d54a65bd61ae2521a9944c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:30.854023 30429 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:30.859778 3196 raft_consensus.cc:2749] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 07:58:30.868407 30429 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:30.862154 3139 raft_consensus.cc:2749] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 07:58:30.883481 31338 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.885624 3237 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:30.893421 3180 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:30.893941 3180 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:30.895957 3180 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:30.898016 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:30.899595 2846 raft_consensus.cc:2749] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 07:58:30.898808 3237 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.908005 3237 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:30.897562 3255 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:30.909861 3255 raft_consensus.cc:697] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:30.909261 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:30.911789 31376 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:58:30.880903 3253 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:30.913208 30542 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:30.918100 30429 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:30.880558 3232 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:30.910784 3255 consensus_queue.cc:237] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.928829 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:30.929642 30429 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:30.935355 30429 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:30.935427 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:30.936213 30360 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:58:30.936861 30429 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:30.937881 3333 raft_consensus.cc:2804] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader election won for term 6
I20260807 07:58:30.937799 3139 raft_consensus.cc:2804] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:58:30.940632 30369 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 10.
I20260807 07:58:30.942265 2846 raft_consensus.cc:2804] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader election won for term 4
I20260807 07:58:30.942875 2846 raft_consensus.cc:697] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:30.938632 3333 raft_consensus.cc:697] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:30.944888 30541 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:30.928355 3250 raft_consensus.cc:2804] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:58:30.950449 3156 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 07:58:30.950321 3173 consensus_queue.cc:1048] T c8f2551f38a348389729e12d49142027 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:30.950886 3156 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:30.942178 3251 raft_consensus.cc:2804] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:58:30.951268 3156 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:30.934871 3232 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.953281 3232 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:30.938687 3139 raft_consensus.cc:697] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [term 4 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:30.948472 3250 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:30.954870 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:30.957124 2846 consensus_queue.cc:237] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:30.957860 30490 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 5.
I20260807 07:58:30.948931 3313 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.960312 31336 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:30.961333 3232 raft_consensus.cc:2804] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:30.961957 3135 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:30.962313 31380 raft_consensus.cc:1240] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260807 07:58:30.962427 3333 consensus_queue.cc:237] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:30.961768 3232 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:30.962914 3135 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.957145 3250 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:30.966801 3271 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:30.961758 3313 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:30.954002 3199 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260807 07:58:30.963649 3232 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:30.971009 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:30.971921 3196 consensus_queue.cc:1059] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:30.972604 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:30.971853 30487 raft_consensus.cc:2393] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 10: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:30.973932 3196 raft_consensus.cc:3055] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Stepping down as leader of term 6
I20260807 07:58:30.974318 3196 raft_consensus.cc:740] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:30.977914 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:30.978538 30588 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 6.
I20260807 07:58:30.965236 3135 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:30.961838 3251 raft_consensus.cc:697] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:30.982431 3196 consensus_queue.cc:260] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:30.983161 3251 consensus_queue.cc:237] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:30.983500 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:30.985198 3196 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:30.985793 3139 consensus_queue.cc:237] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:30.984709 30579 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 10.
I20260807 07:58:30.991458 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:30.992061 30588 raft_consensus.cc:3060] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:31.004300 31338 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:31.009008 30588 raft_consensus.cc:2468] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 7.
I20260807 07:58:30.984730 3232 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.020401 31338 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:31.011813 3311 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 07:58:31.024528 3183 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:31.023699 3311 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:31.026983 3320 raft_consensus.cc:2804] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader election won for term 7
W20260807 07:58:31.041847 30294 auto_rebalancer.cc:644] Failed to schedule move for tablet 02ec7850a44f4310aa712fd0c381c65c: Illegal state: Replica b1188d7d3a0b455894bc443d571f6a19 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
W20260807 07:58:31.045565 3360 log.cc:927] Time spent T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.111s user 0.004s sys 0.000s
I20260807 07:58:31.028219 3295 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:31.047241 3295 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.098372 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:31.098191 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:31.065189 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:31.099716 30579 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:31.099192 30476 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 7
I20260807 07:58:31.043856 3311 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Advancing to term 10
W20260807 07:58:31.103045 3356 log.cc:927] Time spent T 1c3e02cee5d54a65bd61ae2521a9944c P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.169s user 0.004s sys 0.004s
I20260807 07:58:31.058753 3320 raft_consensus.cc:697] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:31.061167 3232 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.044521 3183 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.123898 3183 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.132033 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:31.132747 30587 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 13.
I20260807 07:58:31.135723 30320 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:31.135820 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:31.136504 30477 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 13.
I20260807 07:58:31.123481 3320 consensus_queue.cc:237] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:31.157023 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 142130us
I20260807 07:58:31.151072 30487 consensus_queue.cc:237] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:31.163406 30579 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 7.
I20260807 07:58:31.165753 31338 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:31.120970 3199 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:31.163415 3297 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260807 07:58:31.134817 3250 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.171665 3313 raft_consensus.cc:2804] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:31.188356 30588 raft_consensus.cc:1240] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260807 07:58:31.174662 3297 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:31.199925 30366 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260807 07:58:31.171835 3199 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.202433 3313 raft_consensus.cc:697] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:31.209950 3313 consensus_queue.cc:237] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.210625 3295 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:31.200105 3297 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 13 FOLLOWER]: Advancing to term 14
I20260807 07:58:31.212863 3311 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.222587 3199 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:31.222678 3250 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:31.224089 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:31.225660 30366 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 5
I20260807 07:58:31.228439 3199 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:31.239661 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:31.240327 30369 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 6.
I20260807 07:58:31.242841 30476 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 7.
I20260807 07:58:31.248481 30429 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:31.233632 3156 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.251667 3156 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:31.252916 30582 raft_consensus.cc:1240] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 10. Current term is 11. Ops: []
I20260807 07:58:31.257802 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:31.258555 31377 raft_consensus.cc:3060] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:31.274750 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:31.275647 30476 raft_consensus.cc:2393] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in current term 10: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:31.276298 3311 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.278456 30366 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:58:31.279867 30541 leader_election.cc:304] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:31.280741 3156 raft_consensus.cc:2804] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election won for term 5
I20260807 07:58:31.282334 3173 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:31.282882 3173 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.283046 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:31.283807 31372 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:58:31.284938 3173 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:31.293200 30323 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:31.301509 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:31.302917 30366 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:31.301949 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:31.296573 3156 raft_consensus.cc:697] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [term 5 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:31.305317 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:31.305336 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:31.305596 31383 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 10.
I20260807 07:58:31.300202 3242 raft_consensus.cc:2804] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:31.309018 3242 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:31.309469 3242 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:31.310745 3156 consensus_queue.cc:237] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.313514 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:31.315855 31380 raft_consensus.cc:2393] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 6: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:58:31.319537 30366 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 11.
I20260807 07:58:31.320502 30541 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:31.323133 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:31.324501 30369 raft_consensus.cc:1275] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 07:58:31.325268 30587 raft_consensus.cc:1275] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:58:31.322165 2946 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:31.326625 3250 raft_consensus.cc:2804] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader election won for term 11
I20260807 07:58:31.334030 3250 raft_consensus.cc:697] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [term 11 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:31.333751 2946 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.334975 3250 consensus_queue.cc:237] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.336922 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:31.337826 31377 raft_consensus.cc:2468] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:58:31.336221 2946 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:58:31.339445 3373 log.cc:927] Time spent T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.107s user 0.000s sys 0.000s
I20260807 07:58:31.326424 3233 consensus_queue.cc:1059] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260807 07:58:31.301928 3139 raft_consensus.cc:2804] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:31.341560 3139 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:31.341975 3139 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:31.347143 30586 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 10.
I20260807 07:58:31.348320 31338 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:31.349094 2946 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Leader election won for term 10
I20260807 07:58:31.350477 2946 raft_consensus.cc:697] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:31.351403 2946 consensus_queue.cc:237] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.352332 30219 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53656 (request call id 423) took 1865 ms. Trace:
I20260807 07:58:31.284013 3297 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.358189 30222 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40988 (request call id 201) took 1069 ms. Trace:
I20260807 07:58:31.355865 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:31.353423 30223 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53640 (request call id 393) took 1209 ms. Trace:
I20260807 07:58:31.364231 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:31.366674 30487 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 13 FOLLOWER]: Advancing to term 14
I20260807 07:58:31.366649 30223 rpcz_store.cc:276] 0807 07:58:30.144064 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:30.144984 (+ 920us) service_pool.cc:224] Handling call
0807 07:58:31.353234 (+1208250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78175,"reported_tablets":1}
I20260807 07:58:31.367566 30476 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 9.
I20260807 07:58:31.357577 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:31.366356 30222 rpcz_store.cc:276] 0807 07:58:30.288934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:30.289317 (+ 383us) service_pool.cc:224] Handling call
0807 07:58:31.358121 (+1068804us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
W20260807 07:58:31.369637 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 43752.1us
I20260807 07:58:31.370533 3145 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:31.355145 3297 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 14 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.373705 30366 raft_consensus.cc:1275] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260807 07:58:31.362679 3233 raft_consensus.cc:3055] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 10 LEADER]: Stepping down as leader of term 10
I20260807 07:58:31.374722 3233 raft_consensus.cc:740] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:31.375762 3196 consensus_queue.cc:1048] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:31.376583 3244 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:31.377161 30487 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 14.
I20260807 07:58:31.352700 30219 rpcz_store.cc:276] 0807 07:58:29.487050 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:29.487199 (+ 149us) service_pool.cc:224] Handling call
0807 07:58:31.352266 (+1865067us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:58:30.979173 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:58:30.979728 (+ 555us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:58:30.979759 (+ 31us) write_op.cc:435] Acquired schema lock
0807 07:58:30.979776 (+ 17us) tablet.cc:662] Decoding operations
0807 07:58:30.980162 (+ 386us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:58:30.980204 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0807 07:58:30.980230 (+ 26us) tablet.cc:685] Acquiring locks for 2 operations
0807 07:58:30.980559 (+ 329us) tablet.cc:701] Row locks acquired
0807 07:58:30.980572 (+ 13us) write_op.cc:260] PREPARE: finished
0807 07:58:30.980708 (+ 136us) write_op.cc:270] Start()
0807 07:58:30.980812 (+ 104us) write_op.cc:276] Timestamp: P: 1786089510980662 usec, L: 0
0807 07:58:30.980836 (+ 24us) op_driver.cc:348] REPLICATION: starting
0807 07:58:30.982199 (+ 1363us) log.cc:844] Serialized 919 byte log entry
0807 07:58:31.286775 (+304576us) op_driver.cc:464] REPLICATION: finished
0807 07:58:31.330107 (+ 43332us) write_op.cc:301] APPLY: starting
0807 07:58:31.330219 (+ 112us) tablet.cc:1367] starting BulkCheckPresence
0807 07:58:31.330338 (+ 119us) tablet.cc:1370] finished BulkCheckPresence
0807 07:58:31.330470 (+ 132us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:58:31.330878 (+ 408us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:58:31.331092 (+ 214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0807 07:58:31.331122 (+ 30us) write_op.cc:312] APPLY: finished
0807 07:58:31.331273 (+ 151us) log.cc:844] Serialized 29 byte log entry
0807 07:58:31.331422 (+ 149us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:31.331499 (+ 77us) write_op.cc:454] Released schema lock
0807 07:58:31.331537 (+ 38us) write_op.cc:341] FINISH: Updating metrics
0807 07:58:31.331952 (+ 415us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:31.331978 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":38344,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":31648,"apply.run_cpu_time_us":1848,"apply.run_wall_time_us":1849,"num_ops":2,"prepare.queue_time_us":421647,"prepare.run_cpu_time_us":2652,"prepare.run_wall_time_us":7344,"replication_time_us":265550,"thread_start_us":20974,"threads_started":1}]]}
I20260807 07:58:31.378293 30317 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:31.380013 3297 raft_consensus.cc:2804] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 14 FOLLOWER]: Leader election won for term 14
I20260807 07:58:31.380812 3297 raft_consensus.cc:697] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [term 14 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:31.381718 3233 consensus_queue.cc:260] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.382972 3233 raft_consensus.cc:3060] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:31.383711 31336 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:31.369362 30586 raft_consensus.cc:3060] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 13 FOLLOWER]: Advancing to term 14
I20260807 07:58:31.387092 30590 raft_consensus.cc:1275] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260807 07:58:31.387153 3251 consensus_queue.cc:1048] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260807 07:58:31.389576 3327 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 07:58:31.390074 3327 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:31.390430 3327 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:31.391306 3295 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:31.392375 3295 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.394531 30590 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 07:58:31.394454 3295 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.395627 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:31.396225 30487 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 12.
I20260807 07:58:31.397249 30317 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:31.377117 3244 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.397710 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:31.398054 3295 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260807 07:58:31.398264 30578 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 12.
I20260807 07:58:31.398505 3295 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:31.389909 30363 raft_consensus.cc:1275] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260807 07:58:31.399842 3244 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:31.398947 3295 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 12 FOLLOWER]: Advancing to term 13
I20260807 07:58:31.403050 30590 raft_consensus.cc:1275] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:58:31.405694 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:31.405829 3156 consensus_queue.cc:1048] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:31.406399 30363 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:58:31.407853 30366 raft_consensus.cc:1240] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260807 07:58:31.407855 30541 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:31.417605 30360 raft_consensus.cc:1275] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:58:31.422112 30586 raft_consensus.cc:2468] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 14.
I20260807 07:58:31.424340 3230 consensus_queue.cc:1048] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260807 07:58:31.381876 3297 consensus_queue.cc:237] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.432374 30221 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53660 (request call id 371) took 1711 ms. Trace:
I20260807 07:58:31.435695 2846 consensus_queue.cc:1048] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:31.432750 30221 rpcz_store.cc:276] 0807 07:58:29.720483 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:29.721577 (+ 1094us) service_pool.cc:224] Handling call
0807 07:58:31.432308 (+1710731us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:58:30.613368 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:58:30.717676 (+104308us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:58:30.719693 (+ 2017us) write_op.cc:435] Acquired schema lock
0807 07:58:30.726865 (+ 7172us) tablet.cc:662] Decoding operations
0807 07:58:30.745881 (+ 19016us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:58:30.745934 (+ 53us) write_op.cc:641] Partition lock acquired for write op
0807 07:58:30.745964 (+ 30us) tablet.cc:685] Acquiring locks for 1 operations
0807 07:58:30.746154 (+ 190us) tablet.cc:701] Row locks acquired
0807 07:58:30.746172 (+ 18us) write_op.cc:260] PREPARE: finished
0807 07:58:30.746315 (+ 143us) write_op.cc:270] Start()
0807 07:58:30.746439 (+ 124us) write_op.cc:276] Timestamp: P: 1786089510746264 usec, L: 0
0807 07:58:30.746459 (+ 20us) op_driver.cc:348] REPLICATION: starting
0807 07:58:30.747199 (+ 740us) log.cc:844] Serialized 541 byte log entry
0807 07:58:31.175522 (+428323us) op_driver.cc:464] REPLICATION: finished
0807 07:58:31.219246 (+ 43724us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b18003785e0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb10bf31 00007fd6bb1186d1 00007fd6b2169d1a 00007fd6bb8fd5d9 00007fd6b21f23a0 00007fd6b21ece94 00007fd6b21ece05 00007fd6b5273570 00007fd6b526cec7 00007fd6b526c1b9 00007fd6b5276d10
0807 07:58:31.365815 (+146569us) write_op.cc:301] APPLY: starting
0807 07:58:31.385404 (+ 19589us) tablet.cc:1367] starting BulkCheckPresence
0807 07:58:31.409872 (+ 24468us) tablet.cc:1370] finished BulkCheckPresence
0807 07:58:31.413439 (+ 3567us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:58:31.430173 (+ 16734us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:58:31.430355 (+ 182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0807 07:58:31.430397 (+ 42us) write_op.cc:312] APPLY: finished
0807 07:58:31.430579 (+ 182us) log.cc:844] Serialized 23 byte log entry
0807 07:58:31.430773 (+ 194us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:31.430854 (+ 81us) write_op.cc:454] Released schema lock
0807 07:58:31.430892 (+ 38us) write_op.cc:341] FINISH: Updating metrics
0807 07:58:31.431305 (+ 413us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:31.431330 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":489659,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":141106,"apply.run_cpu_time_us":1887,"apply.run_wall_time_us":103953,"mutex_wait_us":9175,"num_ops":1,"prepare.queue_time_us":71601,"prepare.run_cpu_time_us":23091,"prepare.run_wall_time_us":339267,"raft.queue_time_us":210058,"raft.run_cpu_time_us":21203,"raft.run_wall_time_us":156303,"replication_time_us":424711,"spinlock_wait_cycles":8421760,"thread_start_us":340395,"threads_started":4,"wal-append.queue_time_us":242372}]]}
I20260807 07:58:31.427146 3244 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:31.423916 3199 consensus_queue.cc:1048] T 7bb6a0a753b94f2c8b30e9ae87311e53 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260807 07:58:31.424563 3142 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260807 07:58:31.443801 3139 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.444990 3271 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:31.445564 3271 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.446269 3242 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.448318 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:31.448968 30587 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:31.450464 30320 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:31.463003 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:31.451604 3244 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:31.467370 3139 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:31.454836 3253 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:31.469830 30372 raft_consensus.cc:2368] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7.
I20260807 07:58:31.470431 3253 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:31.473734 3253 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:31.476197 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:31.476811 30487 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:31.478983 30429 leader_election.cc:400] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7.
I20260807 07:58:31.479358 30429 leader_election.cc:403] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260807 07:58:31.468528 3244 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:31.489094 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:31.494253 31383 raft_consensus.cc:2393] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 7: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:58:31.496353 30487 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:31.497788 30317 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:31.498642 3183 raft_consensus.cc:2804] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:31.499133 3183 raft_consensus.cc:697] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:31.500005 3183 consensus_queue.cc:237] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.500818 3327 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.505348 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:31.481953 3271 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:31.497229 3142 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7.
I20260807 07:58:31.508057 3179 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:31.513052 3242 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:31.513073 3179 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.528173 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:31.528577 30586 raft_consensus.cc:1275] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:58:31.528899 3179 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:31.529596 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:31.530259 30582 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 9.
I20260807 07:58:31.531468 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:31.532109 31377 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 9.
I20260807 07:58:31.525941 3242 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:31.533356 3242 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:31.533980 3388 log.cc:927] Time spent T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.063s user 0.000s sys 0.000s
I20260807 07:58:31.536623 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:31.537212 30477 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:31.538348 3139 consensus_queue.cc:1048] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:31.538951 30317 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:31.539145 3255 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:31.539880 3271 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:31.540176 30372 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:31.540726 31383 raft_consensus.cc:3060] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:31.535318 30476 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260807 07:58:31.541193 30476 pending_rounds.cc:85] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818: Aborting all ops after (but not including) 7
I20260807 07:58:31.540292 3271 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:31.542462 3271 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:31.541267 31377 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260807 07:58:31.539615 3255 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.545898 30476 pending_rounds.cc:107] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260807 07:58:31.546192 30476 raft_consensus.cc:2889] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:58:31.551517 30221 catalog_manager.cc:5697] T 1c3e02cee5d54a65bd61ae2521a9944c P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 5 to 6, leader changed from ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130) to b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129). New cstate: current_term: 6 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } } }
I20260807 07:58:31.554294 3255 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.535315 30320 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:31.535528 3242 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.557497 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:31.545154 3250 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:31.558331 3327 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:31.560282 30588 raft_consensus.cc:1275] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 07:58:31.561026 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:31.569849 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:31.581321 30581 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 10.
I20260807 07:58:31.573671 30358 raft_consensus.cc:1275] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:58:31.565713 3179 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 07:58:31.587651 3179 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:31.588040 3179 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Advancing to term 10
W20260807 07:58:31.574395 3386 log.cc:927] Time spent T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.122s user 0.001s sys 0.000s
W20260807 07:58:31.574880 3397 log.cc:927] Time spent T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.084s user 0.001s sys 0.000s
I20260807 07:58:31.573838 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:31.578133 3255 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260807 07:58:31.591877 30476 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:31.578797 30586 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:31.596342 31338 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:31.596998 3184 consensus_queue.cc:1048] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 07:58:31.598301 3327 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 07:58:31.598724 3327 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:31.599045 3327 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:31.607686 30372 raft_consensus.cc:1275] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260807 07:58:31.608366 3271 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.557673 30221 catalog_manager.cc:5697] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 5 to 7, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 7 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:31.584010 30358 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:31.611246 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:31.611488 3271 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.611811 30477 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:31.584419 27906 auto_leader_rebalancer.cc:153] leader rebalance for table test-workload
I20260807 07:58:31.619063 31383 raft_consensus.cc:2468] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:31.621400 30477 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 9.
I20260807 07:58:31.622594 30317 leader_election.cc:304] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:31.630126 30221 catalog_manager.cc:5697] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:31.631709 30221 catalog_manager.cc:5697] T 39d207f188764d0caf032e77702cdc6b P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 6 to 8, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 8 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:31.640290 30586 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:31.642583 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:31.643232 30586 raft_consensus.cc:3060] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 9
I20260807 07:58:31.644821 2846 consensus_queue.cc:1048] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260807 07:58:31.644608 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 319303us
I20260807 07:58:31.647265 30358 raft_consensus.cc:1275] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260807 07:58:31.633222 30221 catalog_manager.cc:5697] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa reported cstate change: term changed from 9 to 10, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132). New cstate: current_term: 10 leader_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260807 07:58:31.652196 3133 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260807 07:58:31.652233 3142 consensus_queue.cc:1048] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260807 07:58:31.658993 30476 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 10.
I20260807 07:58:31.660318 31336 leader_election.cc:304] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:31.615904 3295 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.650354 30430 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters: f831a53ec51d452398015797d543164e
I20260807 07:58:31.637712 3184 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:31.660336 3297 raft_consensus.cc:2804] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 07:58:31.681710 30586 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 9.
I20260807 07:58:31.695412 30588 raft_consensus.cc:1275] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260807 07:58:31.673527 3311 raft_consensus.cc:2804] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Leader election won for term 10
I20260807 07:58:31.670506 3411 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:31.683476 3297 raft_consensus.cc:697] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [term 9 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
W20260807 07:58:31.727002 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 76732us
I20260807 07:58:31.677472 3184 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.714057 3271 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:58:31.727913 30430 consensus_peers.cc:597] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 -> Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619): Couldn't send request to peer 6bd20e9c0d3e4ace86fc1f55ab9425fa. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 726dbe2fbaee4ca8aa75b18959ed1ef5. This is attempt 1: this message will repeat every 5th retry.
I20260807 07:58:31.720551 3311 raft_consensus.cc:697] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:31.741225 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:31.739305 3403 consensus_queue.cc:1048] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:31.746855 3244 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.735327 3251 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:31.717326 3411 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.738487 3297 consensus_queue.cc:237] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.740077 3295 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 13 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.743687 3253 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.756474 30476 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Advancing to term 13
I20260807 07:58:31.756361 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:31.771494 30582 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Advancing to term 13
I20260807 07:58:31.731770 3199 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 07:58:31.746902 3184 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.758527 2846 consensus_queue.cc:1048] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260807 07:58:31.779508 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:31.780423 30489 raft_consensus.cc:1275] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260807 07:58:31.759548 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 63490.4us
I20260807 07:58:31.784574 30490 raft_consensus.cc:2393] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 7: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:31.781831 30477 raft_consensus.cc:1275] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260807 07:58:31.790195 3393 log.cc:927] Time spent T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.294s user 0.002s sys 0.004s
I20260807 07:58:31.792440 3244 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:31.794198 3253 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:31.795997 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:31.796255 30587 raft_consensus.cc:1275] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260807 07:58:31.797348 30480 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260807 07:58:31.797727 30480 pending_rounds.cc:85] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818: Aborting all ops after (but not including) 7
I20260807 07:58:31.797955 30480 pending_rounds.cc:107] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260807 07:58:31.798179 30480 raft_consensus.cc:2889] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:58:31.800300 30477 raft_consensus.cc:1275] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:31.802258 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:31.802867 30490 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 8.
I20260807 07:58:31.804287 31336 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:31.773442 3199 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:31.735666 3271 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.812536 3180 consensus_queue.cc:1048] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260807 07:58:31.813752 30579 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:31.814935 3250 consensus_queue.cc:1048] T 02ec7850a44f4310aa712fd0c381c65c P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 07:58:31.827560 30480 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260807 07:58:31.818825 30582 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 13.
I20260807 07:58:31.827951 30480 pending_rounds.cc:85] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818: Aborting all ops after (but not including) 6
I20260807 07:58:31.828227 30480 pending_rounds.cc:107] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260807 07:58:31.828437 30480 raft_consensus.cc:2889] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:58:31.833818 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:31.834645 30479 raft_consensus.cc:2393] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 7: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:31.829710 30476 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 13.
I20260807 07:58:31.771611 3251 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.837183 30317 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:31.810165 3184 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:31.818127 3199 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:31.817312 3156 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260807 07:58:31.841137 3184 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:31.830368 3133 consensus_queue.cc:1048] T aa37679a25174c858a325e86cb2d5c94 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260807 07:58:31.850219 3184 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:31.915903 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
W20260807 07:58:31.916697 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 67158.2us
I20260807 07:58:31.849216 3179 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.961822 30582 raft_consensus.cc:1275] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260807 07:58:31.977732 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:31.978395 30579 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 11.
I20260807 07:58:31.905900 3295 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:31.962994 3242 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:31.985662 3295 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.985925 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:31.985975 3242 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:31.986601 30581 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:31.987875 3295 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.988180 3242 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.963467 3251 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:31.966190 3395 log.cc:927] Time spent T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.259s user 0.004s sys 0.000s
W20260807 07:58:31.967072 3347 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3ffe07a564dec8cb26697142f88e4: Append to log took a long time: real 0.172s user 0.001s sys 0.002s
I20260807 07:58:31.843500 3253 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 13 FOLLOWER]: Leader election won for term 13
I20260807 07:58:31.990865 3253 raft_consensus.cc:697] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [term 13 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:31.991294 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:31.991593 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:31.991752 3253 consensus_queue.cc:237] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:31.993775 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 76325.1us
I20260807 07:58:31.997768 3199 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.999532 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:32.000619 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:32.001204 30489 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:32.005766 30317 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:32.012035 3242 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:32.012439 3242 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:32.012770 3242 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:32.013535 30581 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 10.
W20260807 07:58:31.967219 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 137474us
I20260807 07:58:32.017288 3184 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:32.019042 30582 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260807 07:58:32.019604 3184 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:32.025084 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:31.968979 3411 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.970580 3327 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.840370 3311 consensus_queue.cc:237] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:31.972812 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:31.974608 3271 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:31.979779 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:31.979772 30476 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:31.980599 31383 raft_consensus.cc:1275] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260807 07:58:32.031219 30479 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:31.976604 3422 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260807 07:58:31.980064 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:32.030581 30578 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:31.982055 30487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda"
dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
mode: GRACEFUL
new_leader_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:42568
I20260807 07:58:32.039232 30487 raft_consensus.cc:606] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Received request to transfer leadership to TS b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:31.982474 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:31.985118 3179 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:32.043097 3419 consensus_queue.cc:1048] T dde7991fc81a4de2920445f4d2abe599 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:32.043627 3327 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 11 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:32.033595 31383 raft_consensus.cc:1240] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260807 07:58:32.038619 30480 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 11.
I20260807 07:58:31.981664 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:32.038784 30317 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:32.032877 30320 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:32.044211 30482 raft_consensus.cc:1240] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 10. Current term is 11. Ops: []
I20260807 07:58:32.057516 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:32.045684 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:32.047442 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:32.045758 31384 raft_consensus.cc:1275] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:32.059731 30586 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 8.
I20260807 07:58:32.063529 30317 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:32.065840 30320 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:32.074280 3295 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:32.074726 3295 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:32.075037 3412 raft_consensus.cc:2749] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:32.075744 3139 consensus_queue.cc:1048] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260807 07:58:32.076103 3183 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260807 07:58:32.076537 3183 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:32.076864 3183 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Advancing to term 12
I20260807 07:58:32.079756 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:32.080219 3179 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:32.029898 3184 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:32.058971 3271 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260807 07:58:32.077283 3139 raft_consensus.cc:2955] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:32.080334 30578 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:32.072484 30320 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:32.081089 30429 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:32.088050 30372 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:58:32.044584 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:32.075079 3295 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:32.080768 3179 raft_consensus.cc:697] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:32.082472 3431 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260807 07:58:32.084616 3244 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:32.081105 3297 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
W20260807 07:58:32.133366 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 60787.5us
I20260807 07:58:32.092252 3412 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 07:58:32.092038 3411 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:32.112569 31378 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:32.080832 3184 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:32.112906 3333 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:32.152905 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:32.092770 3233 consensus_queue.cc:1048] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260807 07:58:32.161526 31372 raft_consensus.cc:1275] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260807 07:58:32.161080 30584 raft_consensus.cc:2955] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:32.169930 30586 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 14 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260807 07:58:32.134040 3250 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260807 07:58:32.190235 30590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129"
dest_uuid: "f831a53ec51d452398015797d543164e"
mode: GRACEFUL
new_leader_uuid: "ef1ca7acf52a438f89f14707e9e06818"
from {username='slave'} at 127.0.0.1:42838
I20260807 07:58:32.158299 3333 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:32.142802 3244 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:32.206825 31377 raft_consensus.cc:2393] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 7: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
I20260807 07:58:32.143989 3297 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:32.223868 3408 log.cc:927] Time spent T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.499s user 0.005s sys 0.000s
I20260807 07:58:32.154608 3411 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:32.235702 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:32.235006 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:32.203306 3333 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:32.261184 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:32.261937 30585 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:32.210100 3209 raft_consensus.cc:493] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:32.194156 3273 consensus_queue.cc:1059] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260807 07:58:32.228543 3184 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:32.258586 3395 log.cc:927] Time spent T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.051s user 0.001s sys 0.000s
I20260807 07:58:32.214943 3232 consensus_queue.cc:1059] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260807 07:58:32.281577 30585 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 11.
W20260807 07:58:32.289860 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 197279us
I20260807 07:58:32.207858 3179 consensus_queue.cc:237] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:32.297960 31338 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:32.292876 3156 raft_consensus.cc:3055] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 8 LEADER]: Stepping down as leader of term 8
I20260807 07:58:32.301414 2946 raft_consensus.cc:3055] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 LEADER]: Stepping down as leader of term 10
I20260807 07:58:32.275302 3209 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:32.324760 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 84844.2us
I20260807 07:58:32.286140 3271 consensus_queue.cc:1048] T f2c57e3fb98348029b5e341d17d669bd P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260807 07:58:32.304399 3265 raft_consensus.cc:2749] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 07:58:32.340940 30365 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:58:32.317245 2946 raft_consensus.cc:740] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:32.316010 3156 raft_consensus.cc:740] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:32.354271 30482 raft_consensus.cc:1275] T fec40d34629d434cae5f2c35d4e6dfa8 P ef1ca7acf52a438f89f14707e9e06818 [term 14 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260807 07:58:32.327800 3448 ts_tablet_manager.cc:933] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:32.354571 30578 raft_consensus.cc:2468] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 11.
W20260807 07:58:32.362571 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 51679.4us
I20260807 07:58:32.365031 30578 raft_consensus.cc:1240] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260807 07:58:32.366232 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:32.366897 30582 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 7.
W20260807 07:58:32.376569 3437 log.cc:927] Time spent T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.162s user 0.001s sys 0.000s
W20260807 07:58:32.378422 3452 log.cc:927] Time spent T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.050s user 0.001s sys 0.000s
W20260807 07:58:32.380213 3450 log.cc:927] Time spent T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.089s user 0.000s sys 0.000s
I20260807 07:58:32.355368 3242 raft_consensus.cc:515] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:32.437270 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 129083us
W20260807 07:58:32.447440 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 75268.3us
I20260807 07:58:32.451469 30429 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:32.435025 3411 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:32.464748 31376 raft_consensus.cc:1240] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260807 07:58:32.448071 3439 log.cc:927] Time spent T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.187s user 0.001s sys 0.000s
I20260807 07:58:32.442281 3244 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:32.453809 3297 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:32.391950 2946 consensus_queue.cc:260] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:32.494195 2946 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:32.494509 3242 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:32.488148 3442 log.cc:927] Time spent T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.146s user 0.000s sys 0.001s
I20260807 07:58:32.506721 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:32.475824 3466 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Leader election won for term 11
I20260807 07:58:32.524746 30541 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:32.550625 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:32.552168 30578 raft_consensus.cc:1275] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260807 07:58:32.553335 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:32.554005 30581 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 8
I20260807 07:58:32.555367 30582 raft_consensus.cc:2368] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 10. Current term is 11.
I20260807 07:58:32.475739 3464 consensus_queue.cc:1048] T d590969fc25f460ba23a897afd565f56 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260807 07:58:32.563519 3456 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election won for term 7
I20260807 07:58:32.564350 3456 raft_consensus.cc:697] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:32.556527 3473 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260807 07:58:32.557046 3466 raft_consensus.cc:697] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 11 LEADER]: Becoming Leader. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:32.569257 3466 consensus_queue.cc:237] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:32.581622 3456 consensus_queue.cc:237] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:32.588078 30221 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40988 (request call id 202) took 1078 ms. Trace:
I20260807 07:58:32.534586 3209 leader_election.cc:290] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:32.589231 30221 rpcz_store.cc:276] 0807 07:58:31.509657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:31.509812 (+ 155us) service_pool.cc:224] Handling call
0807 07:58:32.588001 (+1078189us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:58:31.777970 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:58:31.778536 (+ 566us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:58:31.778574 (+ 38us) write_op.cc:435] Acquired schema lock
0807 07:58:31.778591 (+ 17us) tablet.cc:662] Decoding operations
0807 07:58:31.779253 (+ 662us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:58:31.779332 (+ 79us) write_op.cc:641] Partition lock acquired for write op
0807 07:58:31.779359 (+ 27us) tablet.cc:685] Acquiring locks for 5 operations
0807 07:58:31.779863 (+ 504us) tablet.cc:701] Row locks acquired
0807 07:58:31.779876 (+ 13us) write_op.cc:260] PREPARE: finished
0807 07:58:31.780014 (+ 138us) write_op.cc:270] Start()
0807 07:58:31.780130 (+ 116us) write_op.cc:276] Timestamp: P: 1786089511779967 usec, L: 0
0807 07:58:31.780149 (+ 19us) op_driver.cc:348] REPLICATION: starting
0807 07:58:31.780807 (+ 658us) log.cc:844] Serialized 2065 byte log entry
0807 07:58:32.069477 (+288670us) op_driver.cc:464] REPLICATION: finished
0807 07:58:32.100285 (+ 30808us) write_op.cc:301] APPLY: starting
0807 07:58:32.100376 (+ 91us) tablet.cc:1367] starting BulkCheckPresence
0807 07:58:32.100585 (+ 209us) tablet.cc:1370] finished BulkCheckPresence
0807 07:58:32.113085 (+ 12500us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:58:32.286057 (+172972us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:58:32.310830 (+ 24773us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0807 07:58:32.315281 (+ 4451us) write_op.cc:312] APPLY: finished
0807 07:58:32.361824 (+ 46543us) log.cc:844] Serialized 47 byte log entry
0807 07:58:32.383835 (+ 22011us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:32.395174 (+ 11339us) write_op.cc:454] Released schema lock
0807 07:58:32.412309 (+ 17135us) write_op.cc:341] FINISH: Updating metrics
0807 07:58:32.446246 (+ 33937us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:32.448945 (+ 2699us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":30555,"apply.run_cpu_time_us":5032,"apply.run_wall_time_us":327565,"num_ops":5,"prepare.queue_time_us":94630,"prepare.run_cpu_time_us":3148,"prepare.run_wall_time_us":3153,"replication_time_us":289160,"thread_start_us":94815,"threads_started":2}]]}
I20260807 07:58:32.590531 30581 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:32.594167 30223 catalog_manager.cc:5697] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b1188d7d3a0b455894bc443d571f6a19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
W20260807 07:58:32.619844 31338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:32.598661 30223 catalog_manager.cc:5697] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 5 to 6, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
I20260807 07:58:32.623152 30223 catalog_manager.cc:5697] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 reported cstate change: term changed from 7 to 8, leader changed from b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 8 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } }
W20260807 07:58:32.645466 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 69932.8us
W20260807 07:58:32.679380 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 209593us
I20260807 07:58:32.683053 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:32.655581 3448 tablet_copy_client.cc:323] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Beginning tablet copy session from remote peer at address 127.27.64.130:35917
W20260807 07:58:32.692868 31378 consensus_meta.cc:287] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent flushing consensus metadata: real 0.526s user 0.009s sys 0.004s
I20260807 07:58:32.693459 31378 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 10.
I20260807 07:58:32.698729 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:32.699599 30480 raft_consensus.cc:2393] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 7: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:32.702850 31338 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:32.670097 3412 raft_consensus.cc:697] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [term 10 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:32.714854 30539 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:32.727447 31338 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:32.728410 3265 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260807 07:58:32.717303 3183 consensus_meta.cc:287] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.640s user 0.009s sys 0.005s
I20260807 07:58:32.718076 3327 raft_consensus.cc:2804] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 11 FOLLOWER]: Leader election won for term 11
W20260807 07:58:32.732663 3295 consensus_meta.cc:287] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.594s user 0.002s sys 0.012s
I20260807 07:58:32.729068 3265 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:32.724323 3139 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34352 (request call id 16) took 1659 ms. Trace:
I20260807 07:58:32.748634 3199 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:32.755756 3265 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:32.754102 3327 raft_consensus.cc:697] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 11 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:32.743135 3183 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:32.778002 3333 consensus_meta.cc:287] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818: Time spent flushing consensus metadata: real 0.511s user 0.013s sys 0.001s
I20260807 07:58:32.779317 3333 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:32.780827 3251 raft_consensus.cc:993] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818: : Instructing follower b1188d7d3a0b455894bc443d571f6a19 to start an election
I20260807 07:58:32.781567 3251 raft_consensus.cc:1081] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Signalling peer b1188d7d3a0b455894bc443d571f6a19 to start an election
W20260807 07:58:32.785558 3455 log.cc:927] Time spent T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.271s user 0.004s sys 0.000s
I20260807 07:58:32.786458 30360 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda"
dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
from {username='slave'} at 127.0.0.1:45046
I20260807 07:58:32.787078 30360 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 07:58:32.787497 30360 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:32.756100 3295 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:32.764142 3412 consensus_queue.cc:237] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:32.769979 3483 log.cc:927] Time spent T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.098s user 0.000s sys 0.001s
I20260807 07:58:32.810037 30360 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:32.817967 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
W20260807 07:58:32.822788 3490 log.cc:927] Time spent T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.075s user 0.001s sys 0.000s
I20260807 07:58:32.798060 3199 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:32.824966 3199 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:32.836828 30360 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:32.840571 30363 raft_consensus.cc:2393] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 9: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
W20260807 07:58:32.854379 3498 log.cc:927] Time spent T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.096s user 0.001s sys 0.000s
W20260807 07:58:32.855724 3493 log.cc:927] Time spent T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818: Append to log took a long time: real 0.096s user 0.000s sys 0.001s
I20260807 07:58:32.856382 3295 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:32.861212 3327 consensus_queue.cc:237] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:32.870857 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:32.871577 30367 raft_consensus.cc:2468] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 7.
I20260807 07:58:32.875962 3183 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:32.887252 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 131509us
I20260807 07:58:32.889192 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:32.859231 3199 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:32.895730 30360 raft_consensus.cc:3060] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 10
I20260807 07:58:32.895248 30429 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:32.903324 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:32.793690 3489 consensus_queue.cc:1059] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.133s
I20260807 07:58:32.924598 3333 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:32.925897 31372 raft_consensus.cc:2410] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260807 07:58:32.950829 3156 consensus_queue.cc:260] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:32.757550 3139 rpcz_store.cc:276] 0807 07:58:31.049298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:31.049480 (+ 182us) service_pool.cc:224] Handling call
0807 07:58:31.178576 (+129096us) log.cc:844] Serialized 506 byte log entry
0807 07:58:31.209089 (+ 30513us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b180020fce0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb10bf31 00007fd6bb1186d1 00007fd6b21efd33 00007fd6b21f2121 00007fd6b21f20d9 00007fd6b21f2069 00007fd6b21f2031 00007fd6b21f132d 00000000003aa554 00000000003aa399 00007fd6b21d31ea
0807 07:58:31.248739 (+ 39650us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b180020fce0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb10bf31 00007fd6bb1186d1 00007fd6b21efe62 00007fd6b21f2121 00007fd6b21f20d9 00007fd6b21f2069 00007fd6b21f2031 00007fd6b21f132d 00000000003aa554 00000000003aa399 00007fd6b21d31ea
0807 07:58:31.309982 (+ 61243us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b54003a5fa0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b526f522 00007fd6b525028a 00007fd6b5257133 00007fd6b52570b9 00007fd6b5257049 00007fd6b5257011 00007fd6b52561dd 00000000003aa554 00000000003aa399 00007fd6b21efdb5
0807 07:58:31.307924 (+ -2058us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b2c0005b888. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b3bf1c71 00007fd6b3c00c6a 00007fd6b3c008f3 00007fd6b3c00891 00007fd6b5332f32 00007fd6b53330d5 00007fd6b526fa71 00007fd6b525028a 00007fd6b5257133 00007fd6b52570b9 00007fd6b5257049
0807 07:58:31.334687 (+ 26763us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b18002786a0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b53330e1 00007fd6b526fa71 00007fd6b525028a 00007fd6b5257133 00007fd6b52570b9 00007fd6b5257049 00007fd6b5257011 00007fd6b52561dd 00000000003aa554 00000000003aa399
0807 07:58:31.360658 (+ 25971us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b180020fce0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb10bf31 00007fd6bb1186d1 00007fd6b2169d1a 00007fd6bb8fd5d9 00007fd6b91f971f 00007fd6b21efeb1 00007fd6b21f2121 00007fd6b21f20d9 00007fd6b21f2069 00007fd6b21f2031 00007fd6b21f132d
0807 07:58:32.708961 (+1348303us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":174,"mutex_wait_us":154157,"raft.queue_time_us":11230,"raft.run_cpu_time_us":7688,"raft.run_wall_time_us":233210,"spinlock_wait_cycles":47678080,"thread_start_us":22554,"threads_started":1,"wal-append.queue_time_us":22948,"wal-append.run_cpu_time_us":2849,"wal-append.run_wall_time_us":1235273}
I20260807 07:58:32.981972 3265 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:32.993896 3265 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:33.366724 30502 tablet_copy_service.cc:140] P ef1ca7acf52a438f89f14707e9e06818: Received BeginTabletCopySession request for tablet 726dbe2fbaee4ca8aa75b18959ed1ef5 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa ({username='slave'} at 127.0.0.1:34358)
I20260807 07:58:33.367487 30502 tablet_copy_service.cc:161] P ef1ca7acf52a438f89f14707e9e06818: Beginning new tablet copy session on tablet 726dbe2fbaee4ca8aa75b18959ed1ef5 from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa at {username='slave'} at 127.0.0.1:34358: session id = 6bd20e9c0d3e4ace86fc1f55ab9425fa-726dbe2fbaee4ca8aa75b18959ed1ef5
W20260807 07:58:33.368906 30542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s user 0.000s sys 0.015s
W20260807 07:58:33.369212 30542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s user 0.000s sys 0.015s
W20260807 07:58:33.369985 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 638256us
W20260807 07:58:33.378753 30539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:33.389248 3526 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.389809 3526 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.392810 3526 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:33.431232 3412 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:33.431886 3412 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.433838 3412 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:33.440186 30360 consensus_meta.cc:287] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.544s user 0.008s sys 0.002s
I20260807 07:58:33.441021 30360 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260807 07:58:33.441097 30590 raft_consensus.cc:606] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Received request to transfer leadership to TS ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:33.445451 30590 raft_consensus.cc:614] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260807 07:58:33.446280 3484 raft_consensus.cc:2749] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:58:33.505756 3412 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:33.506476 3412 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.508736 3412 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:33.565224 3412 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:33.565873 3412 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.568130 3412 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:33.618991 3504 log.cc:927] Time spent T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.838s user 0.009s sys 0.000s
I20260807 07:58:33.653337 3156 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:33.687878 30367 raft_consensus.cc:2955] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } } }
I20260807 07:58:33.699885 3412 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.700647 3412 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.714613 3489 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.715461 3489 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.725584 3526 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.726153 3526 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.737264 3533 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.744388 3533 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.746440 3533 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:33.746937 3533 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.747385 3533 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.750545 3526 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:33.749164 3533 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:33.752027 3542 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.752674 3526 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.752652 3509 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:33.754338 3509 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.756332 3509 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:33.756747 3509 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:33.757124 3509 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.758694 3542 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.759356 3544 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.759919 3544 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.760720 3542 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:33.758306 3526 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.769527 3526 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:33.770020 3526 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:33.770488 3526 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.772224 3509 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:33.774333 3526 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:33.774801 3526 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.775208 3526 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:33.775689 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 880455us
I20260807 07:58:33.777304 3526 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:33.777791 3526 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.778198 3526 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.779000 3509 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.780045 3526 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:33.780539 3526 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.781556 3542 consensus_queue.cc:1048] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 07:58:33.782253 3484 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.782799 3484 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.783599 30320 leader_election.cc:400] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 10. Current term is 11.
I20260807 07:58:33.783936 30320 leader_election.cc:403] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:58:33.784665 30320 leader_election.cc:304] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:33.786108 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:33.786907 30367 raft_consensus.cc:2368] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 7. Current term is 8.
I20260807 07:58:33.762087 3544 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:33.788240 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:33.780946 3526 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.789187 30369 raft_consensus.cc:1275] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260807 07:58:33.798220 3484 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:33.799180 30358 raft_consensus.cc:1275] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Refusing update from remote peer f831a53ec51d452398015797d543164e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260807 07:58:33.779565 3509 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.806493 3509 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:33.810618 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 568509us
I20260807 07:58:33.811280 3543 raft_consensus.cc:2804] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:33.824542 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:33.824723 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:33.825219 30581 raft_consensus.cc:3060] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:33.825317 30582 raft_consensus.cc:3060] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:33.825990 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:33.826610 30578 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Advancing to term 12
I20260807 07:58:33.827643 30584 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260807 07:58:33.827677 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:33.826532 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:33.829793 30586 raft_consensus.cc:2468] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:58:33.837018 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:33.837561 30579 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260807 07:58:33.840101 30581 raft_consensus.cc:2468] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 10.
I20260807 07:58:33.832862 3542 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.841125 3542 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.829206 3484 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.844355 3484 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.829022 3547 raft_consensus.cc:3060] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Advancing to term 11
I20260807 07:58:33.846100 30587 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 2723) took 1720 ms. Trace:
I20260807 07:58:33.823390 3544 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:33.847571 3526 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:33.846465 30587 rpcz_store.cc:276] 0807 07:58:32.125634 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:32.156862 (+ 31228us) service_pool.cc:224] Handling call
0807 07:58:32.157063 (+ 201us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:58:32.233804 (+ 76741us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:32.233834 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:58:32.245937 (+ 12103us) log.cc:844] Serialized 26 byte log entry
0807 07:58:33.439744 (+1193807us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b1800265960. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb10bf31 00007fd6bb1186d1 00007fd6b21d27b7 00007fd6bb07afc9 00007fd6b21eefdb 00007fd6b21ed2db 00007fd6b21ef542 00007fd6b4e8f3fb 00007fd6b4e94f13 00007fd6b4e952c1 00007fd6b52b1def
0807 07:58:33.440500 (+ 756us) raft_consensus.cc:1645] Marking committed up to 2
0807 07:58:33.440540 (+ 40us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:33.845777 (+405237us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b54001680d4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:58:33.845832 (+ 55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:58:33.845880 (+ 48us) raft_consensus.cc:1685] finished
0807 07:58:33.845895 (+ 15us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:33.846021 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10017,"raft.queue_time_us":24737,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4334,"spinlock_wait_cycles":180077824,"thread_start_us":564,"threads_started":1,"wal-append.queue_time_us":1172325}
I20260807 07:58:33.848716 3526 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.849206 3526 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.830938 3509 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:33.851533 30578 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 12.
I20260807 07:58:33.851698 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:33.841675 3549 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:33.850821 3544 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.857445 30587 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:33.858749 3544 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:33.857451 3549 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.860952 3549 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:33.834280 3533 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.861651 3533 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.863617 3533 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:33.852842 3509 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.869501 3509 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:33.846397 3484 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:33.856776 30582 raft_consensus.cc:2468] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 9.
I20260807 07:58:33.865777 3549 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:33.870838 3549 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.866966 3526 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:33.867453 3544 consensus_queue.cc:1048] T fec40d34629d434cae5f2c35d4e6dfa8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260807 07:58:33.875799 3549 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:33.878963 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:33.879498 3542 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:33.882602 30582 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:58:33.850572 3543 raft_consensus.cc:697] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 8 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:33.884145 3543 consensus_queue.cc:237] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.888585 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:33.889194 30582 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 9.
I20260807 07:58:33.875926 3547 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer f831a53ec51d452398015797d543164e (127.27.64.131:33207) with higher term. Message: Invalid argument: T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 10. Current term is 11.
I20260807 07:58:33.878057 3561 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.890684 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:33.885581 3412 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:33.893883 30587 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 13 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260807 07:58:33.898849 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 63012.7us
I20260807 07:58:33.900069 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:33.896560 3561 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.902076 30541 leader_election.cc:400] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 7. Current term is 8.
I20260807 07:58:33.902658 30541 leader_election.cc:403] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:58:33.901440 30587 raft_consensus.cc:2468] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:58:33.903210 3549 raft_consensus.cc:2749] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407) with higher term. Message: Invalid argument: T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e for earlier term 7. Current term is 8.
I20260807 07:58:33.903846 3526 consensus_queue.cc:1048] T fe6785f099494896ae258fd098deadc1 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:33.906441 3549 consensus_queue.cc:1048] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260807 07:58:33.915712 3547 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.916252 3547 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.917778 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:33.918406 3547 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:33.918912 3547 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.919238 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:33.919399 3547 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.921764 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:33.922154 3547 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:33.923897 3547 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:58:33.926159 30542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:33.924615 3547 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.928303 3547 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:33.929113 3499 log.cc:927] Time spent T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 1.150s user 0.008s sys 0.008s
I20260807 07:58:33.931846 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:33.937549 3412 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.939270 3418 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.926163 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:33.940277 3265 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:33.940783 3265 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.942785 30588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34604 (request call id 2376) took 1351 ms. Trace:
I20260807 07:58:33.943158 30588 rpcz_store.cc:276] 0807 07:58:32.591248 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:32.591364 (+ 116us) service_pool.cc:224] Handling call
0807 07:58:32.599718 (+ 8354us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:58:32.600130 (+ 412us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:32.600161 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:58:32.603250 (+ 3089us) log.cc:844] Serialized 26 byte log entry
0807 07:58:32.713839 (+110589us) raft_consensus.cc:1645] Marking committed up to 11
0807 07:58:32.713887 (+ 48us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:32.713960 (+ 73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:58:33.928630 (+1214670us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b440002250c. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b2116855 00007fd6b2117272 00007fd6b4ea13bb 00007fd6b4e9cc9f 00007fd6b4e90a5e 00007fd6b4e8fda6 00007fd6b4e8f9c8 00007fd6b4e99411 00007fd6b4e993c9 00007fd6b4e99359
0807 07:58:33.942486 (+ 13856us) raft_consensus.cc:1685] finished
0807 07:58:33.942521 (+ 35us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:33.942727 (+ 206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":688,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3436,"spinlock_wait_cycles":23130368,"thread_start_us":69218,"threads_started":1,"wal-append.queue_time_us":150915}
I20260807 07:58:33.913460 3561 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:33.946205 3265 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:33.947655 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:33.948407 31384 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59320 (request call id 665) took 1061 ms. Trace:
I20260807 07:58:33.949095 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:33.948757 31384 rpcz_store.cc:276] 0807 07:58:32.886768 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:32.887491 (+ 723us) service_pool.cc:224] Handling call
0807 07:58:32.887793 (+ 302us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:58:32.889964 (+ 2171us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:32.889993 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:58:32.893738 (+ 3745us) log.cc:844] Serialized 26 byte log entry
0807 07:58:33.947876 (+1054138us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b54008f6ea0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b5260470 00007fd6b526da98 00007fd6b52f6d0b 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c
0807 07:58:33.947942 (+ 66us) raft_consensus.cc:1645] Marking committed up to 7
0807 07:58:33.948005 (+ 63us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:33.948080 (+ 75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:58:33.948123 (+ 43us) raft_consensus.cc:1685] finished
0807 07:58:33.948137 (+ 14us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:33.948324 (+ 187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1784,"raft.queue_time_us":2287,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":6334,"spinlock_wait_cycles":16020352,"thread_start_us":77563,"threads_started":1,"wal-append.queue_time_us":96137}
I20260807 07:58:33.950850 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:33.939644 3412 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.957585 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:33.954054 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:33.955186 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:33.960614 3412 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:33.939815 3418 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:33.963665 3418 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:33.965809 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:33.966759 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:33.967375 30369 raft_consensus.cc:2468] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 3.
I20260807 07:58:33.969033 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:33.956247 3459 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:33.971908 3459 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:33.973160 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:33.975236 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:33.975948 30369 raft_consensus.cc:2468] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 6.
I20260807 07:58:33.978477 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:33.980468 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:33.981108 30369 raft_consensus.cc:2468] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 5.
I20260807 07:58:33.982486 3459 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:33.984536 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:33.985073 30581 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:33.975165 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:34.182938 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:34.198464 3180 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:34.186069 3311 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260807 07:58:34.158859 31376 raft_consensus.cc:1275] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260807 07:58:34.199945 3180 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.174440 30358 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260807 07:58:34.058605 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:34.185951 3465 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
W20260807 07:58:34.165571 3156 consensus_meta.cc:287] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.511s user 0.010s sys 0.003s
I20260807 07:58:34.202229 3465 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.202672 3180 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:34.176365 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:34.203564 31380 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:58:34.120296 30490 raft_consensus.cc:1275] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260807 07:58:34.204308 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 86708.5us
I20260807 07:58:34.134671 3544 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:34.205036 3565 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 07:58:34.045020 30581 raft_consensus.cc:2468] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 8.
I20260807 07:58:34.206228 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:34.206430 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:33.989257 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:34.207916 3180 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:34.171831 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:34.209189 30587 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 11.
I20260807 07:58:34.209496 3565 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.210103 3565 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:34.211071 30320 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:34.212829 3533 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:34.213887 3565 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:34.214114 30320 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:34.208431 3180 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.217202 3180 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:34.217638 3543 raft_consensus.cc:2804] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:58:34.218077 3543 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:34.163547 3459 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:34.218483 3543 raft_consensus.cc:3060] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:34.218897 3459 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:34.154594 31383 raft_consensus.cc:1240] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:34.221617 3547 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260807 07:58:34.168994 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:34.245618 30360 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 5.
W20260807 07:58:34.128576 31336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 105882us
I20260807 07:58:34.254241 3265 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.256233 3265 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.258730 3265 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:34.119858 3184 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.215876 30320 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:58:34.259855 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 44042.9us
I20260807 07:58:34.230788 30367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:34.259754 3184 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.260700 30367 raft_consensus.cc:2468] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 9.
I20260807 07:58:34.261070 3565 raft_consensus.cc:2804] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Leader election won for term 10
I20260807 07:58:34.261853 3565 raft_consensus.cc:697] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 10 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:34.262727 3184 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:34.230959 3544 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.262753 3565 consensus_queue.cc:237] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:34.233461 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:34.265712 30358 raft_consensus.cc:2468] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:58:34.236932 30586 raft_consensus.cc:1275] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260807 07:58:34.272949 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:34.260609 30320 leader_election.cc:304] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:34.274571 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:34.275085 30590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42838 (request call id 34) took 2085 ms. Trace:
I20260807 07:58:34.275593 30590 rpcz_store.cc:276] 0807 07:58:32.189935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:32.190094 (+ 159us) service_pool.cc:224] Handling call
0807 07:58:34.274870 (+2084776us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001680d4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f0c33 00007fd6ba2f041a 00007fd6b3844934 00007fd6b38448c2 00007fd6b38447f1 00007fd6b384476c 00007fd6b3843a22 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:58:34.274976 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2875261312}
I20260807 07:58:34.282117 31338 leader_election.cc:304] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:34.283013 31338 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:34.285841 3533 raft_consensus.cc:2804] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 12 FOLLOWER]: Leader election won for term 12
I20260807 07:58:34.286473 3533 raft_consensus.cc:697] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [term 12 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:34.287427 3412 consensus_queue.cc:1048] T d0f6bb896213415485f2dee06ba250b8 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260807 07:58:34.288348 3320 raft_consensus.cc:2804] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader election won for term 8
I20260807 07:58:34.287714 3533 consensus_queue.cc:237] T f6c4147ecb7e4996ac3b4ff12effa194 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:34.288861 3320 raft_consensus.cc:697] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:34.244985 3459 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:34.289806 30323 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters:
I20260807 07:58:34.292810 3412 raft_consensus.cc:2804] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:34.290572 2846 raft_consensus.cc:2804] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:34.294052 2846 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:34.241995 3465 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:34.286572 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:34.265190 3544 leader_election.cc:290] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:34.293258 3412 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.294421 2846 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:34.295976 3412 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:34.297936 30320 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:34.285964 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:34.303452 2846 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:34.303879 3543 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.328850 3543 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:34.329063 3489 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:34.334964 2846 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:34.335333 3365 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:34.335932 3365 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.341482 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.342254 30490 raft_consensus.cc:2368] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 9. Current term is 10.
W20260807 07:58:34.344558 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 46696.2us
I20260807 07:58:34.345285 30320 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:34.346153 30320 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:58:34.348387 30323 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 53968.1us
I20260807 07:58:34.348587 30320 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:34.351104 3365 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:34.350243 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.359583 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:34.304108 3412 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.304701 3574 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260807 07:58:34.361438 3574 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:34.361898 3574 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 11 FOLLOWER]: Advancing to term 12
I20260807 07:58:34.363837 3311 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.364406 3311 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.309734 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a83ce36401344a4bb739af7bc87033e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:34.365911 30478 raft_consensus.cc:3060] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:34.310547 30482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:34.311303 3265 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.311822 30477 raft_consensus.cc:1275] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260807 07:58:34.312896 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:34.318589 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.320041 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.321585 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.293212 3320 consensus_queue.cc:237] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:34.311369 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 505543us
I20260807 07:58:34.322638 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.325911 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c4147ecb7e4996ac3b4ff12effa194" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:34.368916 30482 raft_consensus.cc:3055] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Stepping down as leader of term 9
I20260807 07:58:34.373792 30489 raft_consensus.cc:2393] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 9: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:34.373349 30320 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:34.343935 3467 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:34.379233 30478 raft_consensus.cc:2468] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:34.376330 2846 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:34.373986 3477 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:34.383962 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:34.398524 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.386987 30480 raft_consensus.cc:3060] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Advancing to term 12
I20260807 07:58:34.400574 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.387908 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.402108 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.403280 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.399776 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.404400 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.405139 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:58:34.405454 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 64301.2us
I20260807 07:58:34.406512 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.394482 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.396083 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.408082 30477 raft_consensus.cc:2468] T ed9fcd0597fe4e24a7e11fe5c535623c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
I20260807 07:58:34.408314 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.396374 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.397011 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.409500 30476 raft_consensus.cc:2468] T 30057a01f5fa4baba4b3b02fe84a0f78 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:58:34.410681 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.395326 30539 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:34.409477 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.394845 2846 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:34.387203 30482 raft_consensus.cc:740] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:34.415206 30539 leader_election.cc:304] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:34.417148 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:34.424273 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.425938 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.427583 30539 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:34.429358 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:34.429597 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.370344 3544 raft_consensus.cc:2804] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader election won for term 9
I20260807 07:58:34.431917 30372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:34.430034 30590 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:58:34.379804 3543 raft_consensus.cc:2804] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:34.434216 3180 raft_consensus.cc:2749] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:34.435125 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.438164 2846 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:34.347568 3561 consensus_queue.cc:1059] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260807 07:58:34.369076 3560 raft_consensus.cc:2804] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:34.440836 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.395782 3265 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.396531 3184 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.443310 3526 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:34.444568 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.445230 3550 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:34.445755 3156 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:34.448254 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:34.396225 3477 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.395716 3533 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 07:58:34.450773 30588 raft_consensus.cc:1240] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 9. Current term is 10. Ops: []
I20260807 07:58:34.382447 3365 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:34.457442 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:34.416352 3467 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:34.459014 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 85734.7us
I20260807 07:58:34.461642 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.427243 3491 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:34.458493 30541 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:34.430533 3475 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:34.577852 30480 raft_consensus.cc:2468] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 12.
I20260807 07:58:34.581091 30369 raft_consensus.cc:1240] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 3. Current term is 4. Ops: []
I20260807 07:58:34.468325 30358 raft_consensus.cc:1240] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 5. Current term is 6. Ops: []
I20260807 07:58:34.547609 2846 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:58:34.659701 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 201265us
I20260807 07:58:34.655362 30586 raft_consensus.cc:2393] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 9: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:58:34.673205 30317 leader_election.cc:400] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 9. Current term is 10.
I20260807 07:58:34.673561 30317 leader_election.cc:403] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260807 07:58:34.466132 3560 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.435253 3233 raft_consensus.cc:493] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:34.688165 30539 leader_election.cc:304] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:34.689407 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:34.451555 3463 raft_consensus.cc:2749] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260807 07:58:34.691288 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 408302us
I20260807 07:58:34.669265 2846 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:34.681209 30541 leader_election.cc:304] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:34.685009 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.695020 30541 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
W20260807 07:58:34.676321 30429 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.64.129:36407 timed out after 2.543s (SENT)
I20260807 07:58:34.437135 3489 raft_consensus.cc:2804] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:34.451004 3474 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:34.700033 30502 tablet_copy_source_session.cc:215] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P ef1ca7acf52a438f89f14707e9e06818: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 07:58:34.700474 3180 raft_consensus.cc:2804] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:34.701215 3180 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.701592 3180 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:34.703605 30502 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:34358 (request call id 618) took 1875 ms. Trace:
I20260807 07:58:34.703979 30502 rpcz_store.cc:276] 0807 07:58:32.844665 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:33.366416 (+521751us) service_pool.cc:224] Handling call
0807 07:58:34.699662 (+1333246us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54001c8ed4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b53007d7 00007fd6ba2c7e46 00007fd6ba2d184e 00007fd6b1b4561b 00007fd6ba2d17ca 00007fd6ba2cc8dc 00007fd6ba2c7a8b 00007fd6ba2bc6e1 00007fd6b936f5d4 00007fd6b936f562
0807 07:58:34.703475 (+ 3813us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2130724608}
I20260807 07:58:34.700126 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.662283 3184 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.670523 3544 raft_consensus.cc:697] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [term 9 LEADER]: Becoming Leader. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:34.695535 30539 leader_election.cc:304] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:34.696313 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:34.697111 30541 leader_election.cc:304] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:34.697587 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:34.698592 30478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.442307 3543 raft_consensus.cc:493] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.699741 3156 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.636689 3412 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:34.685617 3559 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:34.700735 3474 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.692167 3459 raft_consensus.cc:2749] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:34.791075 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.710932 30358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:34.699728 3465 raft_consensus.cc:2749] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:34.654829 3533 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.716250 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:34.578990 3565 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.718254 30478 raft_consensus.cc:2468] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:58:34.589752 3589 raft_consensus.cc:2804] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:58:34.678467 3209 raft_consensus.cc:2804] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260807 07:58:34.705735 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.799201 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.763126 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:34.686928 3560 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:34.469908 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.589564 3232 consensus_queue.cc:1048] T 37222025709f4384a02a9c633ee3190c P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
I20260807 07:58:34.788307 30222 catalog_manager.cc:5697] T 1d130f3994424c29b619c9f702310fc9 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:34.697891 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:34.806412 30369 raft_consensus.cc:2468] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 4.
I20260807 07:58:34.792192 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:34.705488 3489 raft_consensus.cc:493] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:34.762426 3463 raft_consensus.cc:2749] T 8918375a62fa49ce8a2a4e5ef0f403df P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 07:58:34.717228 3543 raft_consensus.cc:3060] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:34.560915 3584 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.238s
I20260807 07:58:34.705178 3320 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260807 07:58:34.675765 3365 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.692255 3526 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.664731 3550 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:34.824417 3465 raft_consensus.cc:2749] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:34.697535 3233 raft_consensus.cc:515] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:34.828167 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 134393us
I20260807 07:58:34.797485 3533 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:34.817929 3565 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:34.663434 3475 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.798228 3209 raft_consensus.cc:493] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:34.798034 3589 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.793653 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.821859 3489 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:34.662515 3491 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:34.706832 3544 consensus_queue.cc:237] T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:34.854663 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 393603us
I20260807 07:58:34.825255 3586 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:34.841615 3184 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:34.791504 3559 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:34.861442 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 165973us
W20260807 07:58:34.866133 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 169091us
I20260807 07:58:34.872611 30480 raft_consensus.cc:2468] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 13.
I20260807 07:58:34.873648 30317 leader_election.cc:304] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:34.861546 30490 raft_consensus.cc:2393] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 9: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:34.878293 30477 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 7.
W20260807 07:58:34.880180 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 173031us
I20260807 07:58:34.862515 3589 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:34.882067 30541 leader_election.cc:304] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:34.863016 3209 raft_consensus.cc:3060] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:34.885854 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:34.865113 3561 raft_consensus.cc:2749] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917) with higher term. Message: Invalid argument: T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for earlier term 9. Current term is 10.
I20260807 07:58:34.892560 30541 leader_election.cc:304] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:34.895085 30317 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:34.901413 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:58:34.887329 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 211026us
I20260807 07:58:34.909948 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:34.912392 30367 raft_consensus.cc:1240] T 26a3620947f6449ab35a25835dd90fda P b1188d7d3a0b455894bc443d571f6a19 [term 10 LEADER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 9. Current term is 10. Ops: []
I20260807 07:58:34.892058 3465 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:34.935220 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:34.940506 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:34.944376 30364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:34.947227 30365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
W20260807 07:58:34.948559 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 112696us
W20260807 07:58:34.969786 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 77290us
I20260807 07:58:34.975111 31338 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:34.987798 30541 leader_election.cc:304] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:34.982326 30539 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:34.936566 3467 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:34.987308 3574 consensus_meta.cc:287] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent flushing consensus metadata: real 0.625s user 0.009s sys 0.003s
I20260807 07:58:35.003185 3156 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:35.003384 3593 log.cc:927] Time spent T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Append to log took a long time: real 0.099s user 0.001s sys 0.000s
I20260807 07:58:35.004014 3197 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:34.934721 3612 raft_consensus.cc:2804] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:34.973538 3466 raft_consensus.cc:493] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
W20260807 07:58:35.010527 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 115501us
I20260807 07:58:34.986542 3265 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:34.995046 3477 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:34.880837 3586 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:35.019448 30317 leader_election.cc:304] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:34.974927 3465 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:35.181325 3463 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:35.184090 3491 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.189088 3365 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.189705 3526 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.199479 3586 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:35.178915 3233 leader_election.cc:290] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.023818 3197 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:35.192420 3592 log.cc:927] Time spent T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.612s user 0.000s sys 0.004s
I20260807 07:58:35.018702 3612 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:35.202307 3612 raft_consensus.cc:3060] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:35.203394 3197 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.017206 3474 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.064163 31379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:35.032481 3466 raft_consensus.cc:515] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:35.018046 3574 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:35.207779 30363 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45046 (request call id 2853) took 2974 ms (client timeout 2543 ms). Trace:
I20260807 07:58:35.032907 3559 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.177765 3475 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.178858 3550 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:34.997156 3598 raft_consensus.cc:2749] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260807 07:58:35.032826 3600 consensus_queue.cc:1059] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260807 07:58:35.000658 3584 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:34.997519 3605 consensus_queue.cc:1048] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260807 07:58:35.023144 3627 raft_consensus.cc:2804] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260807 07:58:34.990595 3615 raft_consensus.cc:2749] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:35.023882 3156 raft_consensus.cc:2804] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260807 07:58:35.193423 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 174043us
I20260807 07:58:35.195508 3465 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.209347 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:35.210184 30477 raft_consensus.cc:1275] T 4bfc4a881ee74873ae444b3fd4dbcd78 P ef1ca7acf52a438f89f14707e9e06818 [term 13 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260807 07:58:35.211275 31384 raft_consensus.cc:1240] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 12 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 11. Current term is 12. Ops: []
W20260807 07:58:35.210948 30363 rpcz_store.cc:269] 0807 07:58:32.233468 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:32.235463 (+ 1995us) service_pool.cc:224] Handling call
0807 07:58:35.207493 (+2972030us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b5400159ad4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:58:35.207631 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380816128}
I20260807 07:58:34.994148 3184 consensus_queue.cc:1048] T 0eeea67c5e49472292549e65f2c9e844 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260807 07:58:35.233203 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 245461us
I20260807 07:58:35.273401 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
W20260807 07:58:35.265601 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 282392us
I20260807 07:58:35.289825 30429 leader_election.cc:304] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:35.262233 3602 raft_consensus.cc:2749] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260807 07:58:35.287156 30317 leader_election.cc:304] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.288087 30541 leader_election.cc:304] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.208101 3466 leader_election.cc:290] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.180727 3533 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:35.268572 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 286333us
I20260807 07:58:35.292264 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:35.268134 3627 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:35.272816 3156 raft_consensus.cc:493] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:35.295821 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:35.192648 3209 raft_consensus.cc:515] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:35.289469 3598 raft_consensus.cc:493] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:35.305817 30541 leader_election.cc:304] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.311206 30317 leader_election.cc:304] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:35.315259 30541 leader_election.cc:304] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
W20260807 07:58:35.302807 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 314591us
I20260807 07:58:35.273183 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:35.307205 30372 raft_consensus.cc:1240] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 9. Current term is 10. Ops: []
I20260807 07:58:35.308583 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
W20260807 07:58:35.302453 3180 consensus_meta.cc:287] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e: Time spent flushing consensus metadata: real 0.600s user 0.016s sys 0.006s
I20260807 07:58:35.304955 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:35.309940 30539 leader_election.cc:304] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:35.312163 3233 consensus_queue.cc:1059] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260807 07:58:35.325616 30539 leader_election.cc:304] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:35.327481 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:35.327728 3595 raft_consensus.cc:2804] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:58:35.328214 3595 raft_consensus.cc:493] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:35.328588 3595 raft_consensus.cc:3060] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:35.329831 30586 raft_consensus.cc:1240] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 3. Current term is 4. Ops: []
I20260807 07:58:35.330418 3209 leader_election.cc:290] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.331254 3209 raft_consensus.cc:2749] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:35.336475 3632 raft_consensus.cc:2804] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260807 07:58:35.337044 3632 raft_consensus.cc:493] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:35.322189 31338 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.332150 3209 raft_consensus.cc:2804] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260807 07:58:35.309880 3526 raft_consensus.cc:2804] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:58:35.309737 3156 raft_consensus.cc:3060] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:35.343001 30360 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:35.343523 3459 raft_consensus.cc:493] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:35.367916 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:35.368680 31372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59394 (request call id 564) took 1438 ms. Trace:
I20260807 07:58:35.367612 3459 raft_consensus.cc:515] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.366485 3526 raft_consensus.cc:493] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:35.370141 3526 raft_consensus.cc:3060] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:35.305526 3477 consensus_queue.cc:1059] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260807 07:58:35.371438 30223 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53640 (request call id 394) took 3642 ms. Trace:
I20260807 07:58:35.347302 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:35.348722 30477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33928 (request call id 2874) took 1008 ms. Trace:
W20260807 07:58:35.349306 3543 consensus_meta.cc:287] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.512s user 0.003s sys 0.009s
I20260807 07:58:35.309825 3610 raft_consensus.cc:2749] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:35.350085 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:35.372864 30222 catalog_manager.cc:5697] T 5c9372d30eda4764a440dbb9f0bc8129 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 3 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:35.372864 30477 rpcz_store.cc:276] 0807 07:58:34.340458 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:35.194758 (+854300us) service_pool.cc:224] Handling call
0807 07:58:35.209846 (+ 15088us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:35.287150 (+ 77304us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:35.348525 (+ 61375us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b54000d0cd0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f5c8d 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:58:35.348661 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33928064}
I20260807 07:58:35.351171 3533 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:35.352164 3489 raft_consensus.cc:515] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.352869 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:35.355212 3589 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.355484 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:35.321151 3598 raft_consensus.cc:515] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.312136 3574 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 12 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:35.321455 3463 raft_consensus.cc:2749] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:35.311815 3627 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:35.340969 31378 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 10.
I20260807 07:58:35.363111 3233 consensus_queue.cc:1243] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer b1188d7d3a0b455894bc443d571f6a19 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260807 07:58:35.363670 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:35.363885 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:35.341766 3632 raft_consensus.cc:3060] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 13 FOLLOWER]: Advancing to term 14
I20260807 07:58:35.365955 3448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 726dbe2fbaee4ca8aa75b18959ed1ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 07:58:35.366475 3209 raft_consensus.cc:493] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
W20260807 07:58:35.347529 3560 consensus_meta.cc:287] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.514s user 0.006s sys 0.005s
I20260807 07:58:35.367348 30478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33916 (request call id 2903) took 1040 ms. Trace:
I20260807 07:58:35.415105 30317 leader_election.cc:304] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.362339 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:35.366333 30489 raft_consensus.cc:1275] T 0a83ce36401344a4bb739af7bc87033e P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 07:58:35.371099 3459 leader_election.cc:290] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:35.372016 3148 raft_consensus.cc:3055] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Stepping down as leader of term 5
I20260807 07:58:35.377334 3588 raft_consensus.cc:3055] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:35.380365 30222 catalog_manager.cc:5697] T 69fb90f4806e416fb031249c3df91aa8 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 4 to 5, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 5 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
W20260807 07:58:35.385073 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 69873us
I20260807 07:58:35.368975 31372 rpcz_store.cc:276] 0807 07:58:33.930005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:33.934725 (+ 4720us) service_pool.cc:224] Handling call
0807 07:58:35.367853 (+1433128us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b5c0052fd0c. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b8c7fb41 00007fd6b8e259b9 00007fd6ba2ed7c6 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:58:35.368592 (+ 739us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506747264}
I20260807 07:58:35.390117 31380 raft_consensus.cc:2393] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 9: Already voted for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in this term.
W20260807 07:58:35.389073 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 66976.7us
I20260807 07:58:35.412037 30369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e7ae50210ec4ccbb091fa0962200c3e" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:35.424126 30541 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.413316 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
W20260807 07:58:35.414390 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 100301us
I20260807 07:58:35.416509 30478 rpcz_store.cc:276] 0807 07:58:34.326698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:34.698056 (+371358us) service_pool.cc:224] Handling call
0807 07:58:35.367178 (+669122us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b540012c854. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52fa6da 00007fd6ba2ed927 00007fd6b3836834 00007fd6b38367c2 00007fd6b38366f1 00007fd6b383666c 00007fd6b3835922 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:58:35.367289 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22449408}
I20260807 07:58:35.340262 3180 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.389462 3586 raft_consensus.cc:2749] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:35.420542 30317 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:35.421962 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:35.424314 30222 catalog_manager.cc:5697] T 2496d339b41b4d3688937a21d02d09f4 P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 3 to 4, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 4 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:35.425127 31338 leader_election.cc:304] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.426828 30490 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33928 (request call id 2873) took 1086 ms. Trace:
I20260807 07:58:35.432479 30222 catalog_manager.cc:5697] T 917731a02aaa4ad1bda800eb0961e3ce P ef1ca7acf52a438f89f14707e9e06818 reported cstate change: term changed from 5 to 6, leader changed from f831a53ec51d452398015797d543164e (127.27.64.131) to ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130). New cstate: current_term: 6 leader_uuid: "ef1ca7acf52a438f89f14707e9e06818" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } health_report { overall_health: UNKNOWN } } }
I20260807 07:58:35.427534 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:35.428085 30541 leader_election.cc:304] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:35.407389 3533 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:35.415633 3611 raft_consensus.cc:493] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:35.432070 30490 rpcz_store.cc:276] 0807 07:58:34.340196 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:34.910338 (+570142us) service_pool.cc:224] Handling call
0807 07:58:34.910591 (+ 253us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:34.910777 (+ 186us) raft_consensus.cc:1534] Early marking committed up to index 8
0807 07:58:35.216688 (+305911us) log.cc:844] Serialized 14 byte log entry
0807 07:58:35.426508 (+209820us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:35.426561 (+ 53us) raft_consensus.cc:1645] Marking committed up to 8
0807 07:58:35.426606 (+ 45us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:35.426672 (+ 66us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:35.426775 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15818,"prepare.queue_time_us":397667,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":19623,"thread_start_us":461569,"threads_started":2}
W20260807 07:58:35.429605 30539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 104087us
I20260807 07:58:35.417999 3542 raft_consensus.cc:2749] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:35.418941 3459 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:35.381932 3543 raft_consensus.cc:515] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.371842 30223 rpcz_store.cc:276] 0807 07:58:31.728978 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:31.729153 (+ 175us) service_pool.cc:224] Handling call
0807 07:58:35.371351 (+3642198us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0807 07:58:32.770423 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0807 07:58:32.892811 (+122388us) write_op.cc:432] Acquiring schema lock in shared mode
0807 07:58:32.895437 (+ 2626us) write_op.cc:435] Acquired schema lock
0807 07:58:32.895461 (+ 24us) tablet.cc:662] Decoding operations
0807 07:58:32.918113 (+ 22652us) write_op.cc:620] Acquiring the partition lock for write op
0807 07:58:32.918257 (+ 144us) write_op.cc:641] Partition lock acquired for write op
0807 07:58:32.918291 (+ 34us) tablet.cc:685] Acquiring locks for 3 operations
0807 07:58:32.919010 (+ 719us) tablet.cc:701] Row locks acquired
0807 07:58:32.919081 (+ 71us) write_op.cc:260] PREPARE: finished
0807 07:58:32.919319 (+ 238us) write_op.cc:270] Start()
0807 07:58:32.919531 (+ 212us) write_op.cc:276] Timestamp: P: 1786089512919232 usec, L: 0
0807 07:58:32.919554 (+ 23us) op_driver.cc:348] REPLICATION: starting
0807 07:58:32.920711 (+ 1157us) log.cc:844] Serialized 1317 byte log entry
0807 07:58:33.001628 (+ 80917us) op_driver.cc:464] REPLICATION: finished
0807 07:58:33.252385 (+250757us) write_op.cc:301] APPLY: starting
0807 07:58:33.252484 (+ 99us) tablet.cc:1367] starting BulkCheckPresence
0807 07:58:33.252650 (+ 166us) tablet.cc:1370] finished BulkCheckPresence
0807 07:58:33.252776 (+ 126us) tablet.cc:1372] starting ApplyRowOperation cycle
0807 07:58:33.253272 (+ 496us) tablet.cc:1383] finished ApplyRowOperation cycle
0807 07:58:33.253521 (+ 249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0807 07:58:33.253578 (+ 57us) write_op.cc:312] APPLY: finished
0807 07:58:33.253832 (+ 254us) log.cc:844] Serialized 35 byte log entry
0807 07:58:33.254913 (+ 1081us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:33.255007 (+ 94us) write_op.cc:454] Released schema lock
0807 07:58:33.255063 (+ 56us) write_op.cc:341] FINISH: Updating metrics
0807 07:58:33.255450 (+ 387us) write_op.cc:489] Releasing partition, row and schema locks
0807 07:58:33.255475 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27464,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":250469,"apply.run_cpu_time_us":2153,"apply.run_wall_time_us":3036,"num_ops":3,"prepare.queue_time_us":112975,"prepare.run_cpu_time_us":5850,"prepare.run_wall_time_us":162478,"replication_time_us":81863,"thread_start_us":312181,"threads_started":2}]]}
I20260807 07:58:35.438707 30542 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:35.429078 3559 raft_consensus.cc:2749] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:35.419075 3148 raft_consensus.cc:740] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:35.449779 3465 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:35.446969 3622 raft_consensus.cc:2749] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:35.440599 30317 leader_election.cc:304] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.447537 31385 raft_consensus.cc:1240] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 LEADER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260807 07:58:35.430301 3209 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:35.423310 3588 raft_consensus.cc:740] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:35.431512 3463 raft_consensus.cc:2749] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:35.464644 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5785da4aac4398afc22beefd2bd76b" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.464916 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:35.465567 30582 raft_consensus.cc:1275] T 0a83ce36401344a4bb739af7bc87033e P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260807 07:58:35.463196 3654 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:35.463286 30590 raft_consensus.cc:1240] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260807 07:58:35.463299 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.466550 30579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d130f3994424c29b619c9f702310fc9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.466337 3654 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.467074 30581 raft_consensus.cc:2468] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:58:35.467123 30579 raft_consensus.cc:2468] T 1d130f3994424c29b619c9f702310fc9 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 6.
I20260807 07:58:35.468734 3654 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:35.469295 30582 raft_consensus.cc:1275] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Refusing update from remote peer ef1ca7acf52a438f89f14707e9e06818: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260807 07:58:35.469234 3654 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:35.469813 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.469096 30581 raft_consensus.cc:1240] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:35.470167 3654 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:35.473687 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.474442 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.473824 30367 raft_consensus.cc:1240] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 6. Current term is 7. Ops: []
I20260807 07:58:35.475059 30584 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 9.
I20260807 07:58:35.475929 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.476127 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.473995 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.477406 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.474426 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.478809 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bfc4a881ee74873ae444b3fd4dbcd78" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.479398 30584 raft_consensus.cc:2468] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef1ca7acf52a438f89f14707e9e06818 in term 4.
I20260807 07:58:35.438895 3642 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:35.480253 3637 raft_consensus.cc:2749] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:35.483790 3543 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:35.419204 3560 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.454252 3629 raft_consensus.cc:2749] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:35.486747 30317 leader_election.cc:304] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.488847 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6acbd1341f44b138a96457c583930e4" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.493454 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.442117 3612 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.443573 3533 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:35.463825 3645 raft_consensus.cc:2804] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:58:35.452521 3465 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:35.510876 30358 raft_consensus.cc:1240] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 8. Current term is 9. Ops: []
I20260807 07:58:35.485594 3642 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.452559 3148 consensus_queue.cc:260] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:35.519035 3180 leader_election.cc:290] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:35.455562 3459 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:35.521898 30542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 88298.8us
I20260807 07:58:35.573663 30542 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.576189 30363 raft_consensus.cc:1240] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 4. Current term is 5. Ops: []
I20260807 07:58:35.503011 3543 raft_consensus.cc:2749] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260807 07:58:35.579290 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:35.580058 30581 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Advancing to term 12
I20260807 07:58:35.475950 3474 consensus_queue.cc:1059] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260807 07:58:35.448576 3611 raft_consensus.cc:515] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.520767 3645 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:35.571018 3629 raft_consensus.cc:493] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:35.568930 3588 consensus_queue.cc:260] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:35.601923 3459 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:35.602450 3533 leader_election.cc:290] T 14880a591ef44360b5046f67cab3d4ad P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.505184 3584 consensus_queue.cc:1048] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260807 07:58:35.612703 3526 raft_consensus.cc:515] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.615173 30581 raft_consensus.cc:2468] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6bd20e9c0d3e4ace86fc1f55ab9425fa in term 12.
I20260807 07:58:35.622944 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:35.503614 3637 consensus_queue.cc:1048] T 4bfc4a881ee74873ae444b3fd4dbcd78 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260807 07:58:35.599139 3646 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:35.598417 3474 consensus_queue.cc:1243] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260807 07:58:35.626871 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 130741us
I20260807 07:58:35.594352 3589 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:35.603169 3595 raft_consensus.cc:515] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:35.595655 3489 leader_election.cc:290] T ed9fcd0597fe4e24a7e11fe5c535623c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:35.594463 3645 raft_consensus.cc:3060] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:35.625831 30539 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:35.631610 30581 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260807 07:58:35.607702 3602 consensus_queue.cc:1059] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260807 07:58:35.633430 3148 raft_consensus.cc:3060] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Advancing to term 6
I20260807 07:58:35.608592 3629 raft_consensus.cc:515] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.638579 3459 raft_consensus.cc:2804] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:35.657869 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:35.651775 3602 consensus_queue.cc:1243] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Peer 6bd20e9c0d3e4ace86fc1f55ab9425fa log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260807 07:58:35.658566 31385 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 9.
W20260807 07:58:35.665799 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 171001us
I20260807 07:58:35.642486 3598 leader_election.cc:290] T 1906743dbae54f6b90d1d039e2394d50 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:35.644428 3654 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.654974 3459 raft_consensus.cc:493] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:35.677042 30429 leader_election.cc:304] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:35.679733 30542 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:35.669492 3648 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260807 07:58:35.691090 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:35.692291 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:35.691286 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:35.693720 3642 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:35.698663 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:35.681221 3459 raft_consensus.cc:3060] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:35.705065 3526 leader_election.cc:290] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:35.692368 3560 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:35.706465 3611 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:35.689934 3654 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260807 07:58:35.710005 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:35.714211 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "726dbe2fbaee4ca8aa75b18959ed1ef5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.716115 30587 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260807 07:58:35.708959 3465 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.720609 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:35.721369 30581 raft_consensus.cc:2393] T 2496d339b41b4d3688937a21d02d09f4 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 5: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:35.724985 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:35.698231 3612 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:35.725785 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:35.725947 30581 raft_consensus.cc:2393] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 7: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:35.726410 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a35e1cb09e2146a084cf577b068e4140" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:35.690085 3156 raft_consensus.cc:515] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.728437 3662 raft_consensus.cc:2749] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260807 07:58:35.730218 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:35.728328 3542 raft_consensus.cc:493] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:35.727793 30320 leader_election.cc:304] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.732527 30373 raft_consensus.cc:2393] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f831a53ec51d452398015797d543164e in current term 4: Already voted for candidate b1188d7d3a0b455894bc443d571f6a19 in this term.
I20260807 07:58:35.741734 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:35.741814 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:35.732884 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:35.726326 3629 leader_election.cc:290] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:35.738420 30323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:35.714653 3654 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 07:58:35.740280 3311 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:35.718007 3595 leader_election.cc:290] T 30057a01f5fa4baba4b3b02fe84a0f78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.744673 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:35.745580 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:35.745898 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1906743dbae54f6b90d1d039e2394d50" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.746417 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:35.747185 3542 raft_consensus.cc:515] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.754436 31338 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:35.782852 3595 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:35.783308 3209 raft_consensus.cc:515] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:35.783432 3595 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.786150 3595 leader_election.cc:290] T 32d8c79eca1d4172b7e3662b5e509782 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:35.786784 30578 raft_consensus.cc:2393] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef1ca7acf52a438f89f14707e9e06818 in current term 8: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:35.786918 3156 leader_election.cc:290] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:35.787652 3589 raft_consensus.cc:2804] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260807 07:58:35.788057 3589 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:35.788424 3589 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:35.758139 30320 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:35.756299 30489 raft_consensus.cc:1240] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Rejecting Update request from peer f831a53ec51d452398015797d543164e for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:35.762136 30582 raft_consensus.cc:1240] T 42f1efe3594f411d9ed19ae2875c1bf0 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 9. Current term is 10. Ops: []
I20260807 07:58:35.755203 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:35.793530 30320 leader_election.cc:304] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:35.756650 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0032603adf8446cd9a59f26cc868400c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:35.793231 31338 leader_election.cc:304] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.797420 30366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:35.797238 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:35.798198 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:35.796339 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dde7991fc81a4de2920445f4d2abe599" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:35.796217 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec40d34629d434cae5f2c35d4e6dfa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:35.762655 30373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19"
I20260807 07:58:35.759243 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:35.808531 30581 raft_consensus.cc:3060] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:35.744954 3654 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Advancing to term 10
W20260807 07:58:35.844875 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 51422us
I20260807 07:58:35.845341 31338 leader_election.cc:304] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
W20260807 07:58:35.878937 30430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.132:36619, user_credentials={real_user=slave}} blocked reactor thread for 117126us
I20260807 07:58:35.879215 30320 leader_election.cc:304] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e; no voters: ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.880631 30539 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.882586 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8f2551f38a348389729e12d49142027" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:35.882668 30539 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.883785 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f836ea19b1942d09da90d65732435dc" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:35.789778 3632 raft_consensus.cc:515] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.795684 3574 raft_consensus.cc:2749] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:35.884791 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:35.795569 3595 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:58:35.886878 30320 leader_election.cc:304] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19; no voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e
I20260807 07:58:35.749343 3542 leader_election.cc:290] T 75bed1078db6464388c6bf0bea4a4be6 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:35.900403 3637 consensus_queue.cc:1048] T 0a83ce36401344a4bb739af7bc87033e P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260807 07:58:35.911521 3610 raft_consensus.cc:2749] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260807 07:58:35.901031 30489 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:58:35.912024 3638 raft_consensus.cc:2804] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260807 07:58:35.912578 3671 log.cc:927] Time spent T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260807 07:58:35.912874 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:35.913966 3585 raft_consensus.cc:2804] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 12 FOLLOWER]: Leader election won for term 12
I20260807 07:58:35.893610 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:35.910533 30539 leader_election.cc:304] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.885370 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed9fcd0597fe4e24a7e11fe5c535623c" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:35.914079 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f1efe3594f411d9ed19ae2875c1bf0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:35.910607 30541 leader_election.cc:304] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:35.900043 3465 raft_consensus.cc:2749] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260807 07:58:35.920390 3675 log.cc:927] Time spent T 0e7ae50210ec4ccbb091fa0962200c3e P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 0.159s user 0.000s sys 0.000s
I20260807 07:58:35.925812 30541 leader_election.cc:304] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.926718 30487 raft_consensus.cc:3060] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:35.934787 30581 raft_consensus.cc:2468] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 9.
I20260807 07:58:35.878597 3544 raft_consensus.cc:2749] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260807 07:58:35.936930 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2496d339b41b4d3688937a21d02d09f4" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:35.943539 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:35.737747 3645 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:35.945158 30579 raft_consensus.cc:1240] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [term 14 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260807 07:58:35.942411 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e83da4401b5430295d02124cfe24f58" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:35.912478 3638 raft_consensus.cc:493] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:35.921736 30482 consensus_queue.cc:260] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:35.879163 3209 leader_election.cc:290] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.902503 3598 raft_consensus.cc:2804] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:58:35.945971 3542 raft_consensus.cc:493] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:35.946363 3526 raft_consensus.cc:2749] T c8f2551f38a348389729e12d49142027 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260807 07:58:35.947837 30477 raft_consensus.cc:2468] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 9.
I20260807 07:58:35.947150 30541 leader_election.cc:304] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:35.902272 3642 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260807 07:58:35.958534 31338 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 79833.6us
I20260807 07:58:35.947943 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14880a591ef44360b5046f67cab3d4ad" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:35.963799 3577 consensus_queue.cc:1048] T 61ca595a07a748bb83b4aa11cb066270 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260807 07:58:35.974030 3648 raft_consensus.cc:493] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting leader election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:35.974583 3648 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:36.024978 3648 raft_consensus.cc:515] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:36.034970 3648 leader_election.cc:290] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:35.942816 3612 raft_consensus.cc:2749] T a35e1cb09e2146a084cf577b068e4140 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260807 07:58:35.900188 3560 consensus_queue.cc:1059] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260807 07:58:35.956846 30487 raft_consensus.cc:2468] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
W20260807 07:58:36.143169 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 466180us
I20260807 07:58:36.170217 30429 leader_election.cc:304] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:35.903628 3611 consensus_queue.cc:1059] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260807 07:58:36.151783 30584 raft_consensus.cc:1240] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 4. Current term is 5. Ops: []
I20260807 07:58:35.945736 3595 raft_consensus.cc:493] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:35.905745 3584 consensus_queue.cc:1059] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260807 07:58:35.957420 3638 raft_consensus.cc:3060] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:35.956986 3598 raft_consensus.cc:493] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:36.142597 3465 raft_consensus.cc:2749] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:35.959462 3585 raft_consensus.cc:697] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 12 LEADER]: Becoming Leader. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:36.143108 3542 raft_consensus.cc:515] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:36.188112 3627 consensus_meta.cc:287] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent flushing consensus metadata: real 0.770s user 0.005s sys 0.005s
I20260807 07:58:36.151602 3459 raft_consensus.cc:515] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:36.183430 3598 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:36.198623 3559 raft_consensus.cc:2749] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260807 07:58:36.182555 3595 raft_consensus.cc:515] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:36.203316 3632 leader_election.cc:290] T 4bfc4a881ee74873ae444b3fd4dbcd78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 14 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:36.207791 3543 raft_consensus.cc:493] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:36.225541 3459 leader_election.cc:290] T 39d207f188764d0caf032e77702cdc6b P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:36.229772 3148 consensus_meta.cc:287] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818: Time spent flushing consensus metadata: real 0.577s user 0.010s sys 0.001s
I20260807 07:58:36.235934 3595 leader_election.cc:290] T fe6785f099494896ae258fd098deadc1 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:36.200907 3184 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:36.243675 3184 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:36.246081 3311 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:36.248976 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:36.246925 3311 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:36.252102 3311 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:36.253130 30363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b1188d7d3a0b455894bc443d571f6a19" is_pre_election: true
I20260807 07:58:36.209681 3585 consensus_queue.cc:237] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:36.273257 30476 raft_consensus.cc:1240] T aa37679a25174c858a325e86cb2d5c94 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:36.275974 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:36.276407 30585 raft_consensus.cc:1240] T aa37679a25174c858a325e86cb2d5c94 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 7. Current term is 8. Ops: []
I20260807 07:58:36.276934 30489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2c57e3fb98348029b5e341d17d669bd" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:36.277671 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:36.279867 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:36.223084 3543 raft_consensus.cc:515] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:36.297078 30623 debug-util.cc:398] Leaking SignalData structure 0x7b0800116a80 after lost signal to thread 27911
I20260807 07:58:36.298265 3184 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:36.310743 30363 raft_consensus.cc:1240] T a35e1cb09e2146a084cf577b068e4140 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Rejecting Update request from peer 6bd20e9c0d3e4ace86fc1f55ab9425fa for earlier term 3. Current term is 4. Ops: []
W20260807 07:58:36.294559 27906 auto_leader_rebalancer.cc:467] leader transfer for tablet 5c9372d30eda4764a440dbb9f0bc8129 (from f831a53ec51d452398015797d543164e to ef1ca7acf52a438f89f14707e9e06818) failed: code: NOT_THE_LEADER status { code: ILLEGAL_STATE message: "not currently leader" }
W20260807 07:58:36.316836 30623 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2ac0 after lost signal to thread 30272
I20260807 07:58:36.201283 3627 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:36.324565 3542 leader_election.cc:290] T 8918375a62fa49ce8a2a4e5ef0f403df P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:36.328248 3589 consensus_meta.cc:287] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.539s user 0.006s sys 0.005s
W20260807 07:58:36.322667 30623 debug-util.cc:398] Leaking SignalData structure 0x7b080036a1c0 after lost signal to thread 30405
I20260807 07:58:36.335706 31383 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59320 (request call id 680) took 1573 ms. Trace:
I20260807 07:58:36.316223 3565 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:36.336113 31383 rpcz_store.cc:276] 0807 07:58:34.762339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:34.792723 (+ 30384us) service_pool.cc:224] Handling call
0807 07:58:35.357084 (+564361us) spinlock_profiling.cc:243] Waited 8.22 ms on lock 0x7b5800000398. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b21b8521 00007fd6b21b83d2 00007fd6bb124219 00007fd6ba277640 00007fd6ba33febb 00007fd6ba33ff41 00007fd6ba301dd0 00007fd6ba2ec739 00007fd6ba2ec1e2 00007fd6b3831d34
0807 07:58:35.410276 (+ 53192us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:58:35.410626 (+ 350us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:35.410654 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:58:35.415684 (+ 5030us) log.cc:844] Serialized 26 byte log entry
0807 07:58:35.491104 (+ 75420us) raft_consensus.cc:1645] Marking committed up to 9
0807 07:58:35.491145 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:35.491210 (+ 65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:58:35.521683 (+ 30473us) raft_consensus.cc:1685] finished
0807 07:58:35.521700 (+ 17us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:36.335524 (+813824us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b54004fe550. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f5c8d 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:58:36.335645 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5210,"spinlock_wait_cycles":140778112,"thread_start_us":59869,"threads_started":1,"wal-append.queue_time_us":84353}
I20260807 07:58:36.338927 3543 leader_election.cc:290] T 15fa23df425445ce99709045bc6e9789 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:36.340744 30367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45046 (request call id 2891) took 1420 ms. Trace:
I20260807 07:58:36.341138 30367 rpcz_store.cc:276] 0807 07:58:34.919802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:34.929486 (+ 9684us) service_pool.cc:224] Handling call
0807 07:58:34.929795 (+ 309us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:35.475073 (+545278us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:36.340449 (+865376us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54003ae3d4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:58:36.340624 (+ 175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250752896}
I20260807 07:58:36.344110 30586 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42218 (request call id 816) took 1362 ms. Trace:
I20260807 07:58:36.344511 30586 rpcz_store.cc:276] 0807 07:58:34.981850 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:34.984312 (+ 2462us) service_pool.cc:224] Handling call
0807 07:58:34.984621 (+ 309us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:35.330208 (+345587us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:36.343863 (+1013655us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400189054. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:58:36.344050 (+ 187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793478912}
I20260807 07:58:36.349661 3638 raft_consensus.cc:515] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:36.347460 3654 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:36.335826 3645 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 5 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:36.328922 3589 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:36.396026 30319 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:36.376520 3654 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:36.439879 30541 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.129:36407, user_credentials={real_user=slave}} blocked reactor thread for 492773us
I20260807 07:58:36.441161 30541 leader_election.cc:304] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:36.442965 30541 leader_election.cc:304] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818
I20260807 07:58:36.445093 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:36.450345 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:36.450834 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:36.453629 30586 raft_consensus.cc:1275] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260807 07:58:36.453541 30578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:36.454620 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:36.455797 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:36.456004 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:36.457333 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:36.459636 30586 raft_consensus.cc:1240] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 10. Current term is 11. Ops: []
W20260807 07:58:36.451850 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 268064us
I20260807 07:58:36.460887 30429 leader_election.cc:304] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: b1188d7d3a0b455894bc443d571f6a19, f831a53ec51d452398015797d543164e
I20260807 07:58:36.464516 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:36.464653 30429 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
I20260807 07:58:36.465337 30586 raft_consensus.cc:2468] T 15fa23df425445ce99709045bc6e9789 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
I20260807 07:58:36.468225 30429 leader_election.cc:304] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:36.469352 30429 leader_election.cc:304] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:36.470472 30429 leader_election.cc:304] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818, f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa
W20260807 07:58:36.492488 30488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s user 0.023s sys 0.028s
W20260807 07:58:36.497229 30488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s user 0.027s sys 0.028s
I20260807 07:58:36.472631 30429 leader_election.cc:304] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:36.498510 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:36.450057 3654 raft_consensus.cc:2749] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:36.452973 3645 raft_consensus.cc:2749] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:36.714272 3448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:59392 (request call id 578) took 4691 ms. Trace:
I20260807 07:58:36.715253 3448 rpcz_store.cc:276] 0807 07:58:32.022366 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:32.023681 (+ 1315us) service_pool.cc:224] Handling call
0807 07:58:32.360410 (+336729us) ts_tablet_manager.cc:934] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Initiating tablet copy from peer ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
0807 07:58:35.364590 (+3004180us) tablet_copy_client.cc:368] Tablet copy session begun
0807 07:58:36.278481 (+913891us) tablet_metadata.cc:665] Metadata flushed
0807 07:58:36.281722 (+ 3241us) tablet_copy_client.cc:497] Wrote new tablet metadata
0807 07:58:36.712750 (+431028us) tablet_copy_client.cc:418] Wrote new consensus metadata
0807 07:58:36.713268 (+ 518us) tablet_replica.cc:206] Creating consensus instance
0807 07:58:36.713950 (+ 682us) ts_tablet_manager.cc:989] Replica registered.
0807 07:58:36.714107 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":27945,"tablet-copy.queue_time_us":241772,"thread_start_us":295798,"threads_started":2}
I20260807 07:58:36.466701 3333 raft_consensus.cc:2749] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260807 07:58:36.470265 3465 raft_consensus.cc:493] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:36.472141 3251 raft_consensus.cc:2749] T 39d207f188764d0caf032e77702cdc6b P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260807 07:58:36.472572 3638 leader_election.cc:290] T 1d130f3994424c29b619c9f702310fc9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:36.467206 3655 raft_consensus.cc:493] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:36.495384 3365 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260807 07:58:36.492743 3646 raft_consensus.cc:493] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:36.707734 3230 raft_consensus.cc:2749] T dde7991fc81a4de2920445f4d2abe599 P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260807 07:58:36.707952 3418 raft_consensus.cc:3055] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEADER]: Stepping down as leader of term 3
I20260807 07:58:36.722570 3448 tablet_copy_client.cc:806] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 0 data blocks...
I20260807 07:58:36.466740 3403 consensus_queue.cc:1048] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.267s
I20260807 07:58:36.743185 3418 raft_consensus.cc:740] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6bd20e9c0d3e4ace86fc1f55ab9425fa, State: Running, Role: LEADER
I20260807 07:58:36.736413 3365 raft_consensus.cc:493] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:36.792217 3448 tablet_copy_client.cc:670] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: tablet copy: Starting download of 1 WAL segments...
I20260807 07:58:36.792412 3418 consensus_queue.cc:260] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:36.794021 3418 raft_consensus.cc:3060] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 3 FOLLOWER]: Advancing to term 4
I20260807 07:58:36.742619 3333 raft_consensus.cc:2749] T 457aab41fd17414ab083fedaf23f3ff8 P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260807 07:58:36.737098 3693 raft_consensus.cc:2804] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260807 07:58:36.735850 3465 raft_consensus.cc:515] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:36.796625 3365 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Advancing to term 9
I20260807 07:58:36.812469 30582 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34594 (request call id 2752) took 1339 ms. Trace:
I20260807 07:58:36.818221 30582 rpcz_store.cc:276] 0807 07:58:35.472820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:35.474553 (+ 1733us) service_pool.cc:224] Handling call
0807 07:58:35.474793 (+ 240us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:35.793955 (+319162us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:36.812240 (+1018285us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54000bccd4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:58:36.812410 (+ 170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660367104}
I20260807 07:58:36.743779 3646 raft_consensus.cc:515] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:36.802784 3693 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:36.819562 3693 raft_consensus.cc:3060] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:36.820478 2846 leader_election.cc:290] T 6e83da4401b5430295d02124cfe24f58 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:36.821128 3646 leader_election.cc:290] T 457aab41fd17414ab083fedaf23f3ff8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:36.742345 3655 raft_consensus.cc:515] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } attrs { replace: true } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:36.813882 3465 leader_election.cc:290] T f6c4147ecb7e4996ac3b4ff12effa194 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
W20260807 07:58:36.815105 3598 consensus_meta.cc:287] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19: Time spent flushing consensus metadata: real 0.603s user 0.008s sys 0.005s
I20260807 07:58:36.826076 3598 raft_consensus.cc:515] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:36.828012 3598 leader_election.cc:290] T 5c9372d30eda4764a440dbb9f0bc8129 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:36.806604 3589 leader_election.cc:290] T 917731a02aaa4ad1bda800eb0961e3ce P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 election: Requested vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:36.825235 3655 leader_election.cc:290] T 726dbe2fbaee4ca8aa75b18959ed1ef5 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:36.837363 3365 raft_consensus.cc:515] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:37.425966 3693 consensus_meta.cc:287] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818: Time spent flushing consensus metadata: real 0.606s user 0.010s sys 0.000s
W20260807 07:58:37.479702 3418 consensus_meta.cc:287] T a35e1cb09e2146a084cf577b068e4140 P 6bd20e9c0d3e4ace86fc1f55ab9425fa: Time spent flushing consensus metadata: real 0.685s user 0.003s sys 0.007s
W20260807 07:58:37.552295 3711 log.cc:927] Time spent T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e: Append to log took a long time: real 0.295s user 0.001s sys 0.000s
I20260807 07:58:37.521008 3693 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:37.620952 3365 leader_election.cc:290] T 5df190e0d6d146e8a2f82d090c06ecdf P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 9 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:37.686513 3693 leader_election.cc:290] T 0032603adf8446cd9a59f26cc868400c P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 5 election: Requested vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:38.339706 3710 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s user 0.000s sys 0.007s
W20260807 07:58:38.340196 3710 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s user 0.000s sys 0.007s
I20260807 07:58:38.652436 3715 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:38.653182 3715 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:38.655491 3715 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:38.657215 3489 raft_consensus.cc:2749] T fec40d34629d434cae5f2c35d4e6dfa8 P f831a53ec51d452398015797d543164e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260807 07:58:38.657996 30590 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34604 (request call id 2405) took 2945 ms. Trace:
I20260807 07:58:38.658339 30590 rpcz_store.cc:276] 0807 07:58:35.712065 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:35.712190 (+ 125us) service_pool.cc:224] Handling call
0807 07:58:35.712490 (+ 300us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:35.712711 (+ 221us) raft_consensus.cc:1534] Early marking committed up to index 12
0807 07:58:35.723758 (+ 11047us) log.cc:844] Serialized 14 byte log entry
0807 07:58:38.630675 (+2906917us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b180038c740. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6bb10bf31 00007fd6bb1186d1 00007fd6b21d27b7 00007fd6bb07afc9 00007fd6b21eefdb 00007fd6b21ed2db 00007fd6b21ef542 00007fd6b4e8f3fb 00007fd6b4e94f13 00007fd6b4e9542a 00007fd6b5300e0a
0807 07:58:38.656910 (+ 26235us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:38.656972 (+ 62us) raft_consensus.cc:1645] Marking committed up to 12
0807 07:58:38.657036 (+ 64us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:38.657828 (+ 792us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:38.657933 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10917,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":1658,"raft.queue_time_us":116,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":4321664,"thread_start_us":25955,"threads_started":1,"wal-append.queue_time_us":2933021}
I20260807 07:58:38.664783 3720 raft_consensus.cc:493] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:38.665907 3715 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:38.666361 3720 raft_consensus.cc:515] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:38.667320 3715 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:38.668957 3720 leader_election.cc:290] T 26a3620947f6449ab35a25835dd90fda P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:38.669415 3715 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:38.669497 3720 raft_consensus.cc:493] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:38.670213 3720 raft_consensus.cc:515] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:38.671914 30585 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42218 (request call id 821) took 3187 ms. Trace:
I20260807 07:58:38.672169 3720 leader_election.cc:290] T 9136a853c15441a6a0460d9da5efd3e9 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:38.672254 30585 rpcz_store.cc:276] 0807 07:58:35.484848 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:35.489291 (+ 4443us) service_pool.cc:224] Handling call
0807 07:58:36.276219 (+786928us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:36.276808 (+ 589us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:38.671755 (+2394947us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b5400280fd0. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f5c8d 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:58:38.671867 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1809031040}
I20260807 07:58:38.676429 3715 raft_consensus.cc:493] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:38.677069 3715 raft_consensus.cc:515] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:38.679234 3715 leader_election.cc:290] T 8f836ea19b1942d09da90d65732435dc P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:38.687172 3173 raft_consensus.cc:3055] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 11 LEADER]: Stepping down as leader of term 11
I20260807 07:58:38.687610 3173 raft_consensus.cc:740] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef1ca7acf52a438f89f14707e9e06818, State: Running, Role: LEADER
I20260807 07:58:38.688439 3173 consensus_queue.cc:260] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:38.689430 3173 raft_consensus.cc:3060] T 9136a853c15441a6a0460d9da5efd3e9 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Advancing to term 12
W20260807 07:58:38.727208 30320 connection.cc:256] RPC call timeout handler was delayed by -2.2198357249144465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260807 07:58:38.728505 30320 connection.cc:256] RPC call timeout handler was delayed by -2.1397357250098139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
W20260807 07:58:38.729346 30320 connection.cc:256] RPC call timeout handler was delayed by -2.0434357249177992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260807 07:58:38.731411 30320 connection.cc:256] RPC call timeout handler was delayed by -1.9831357249058783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260807 07:58:38.731772 30320 connection.cc:256] RPC call timeout handler was delayed by -1.9345357250422239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
I20260807 07:58:38.730324 30487 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34358 (request call id 634) took 2457 ms. Trace:
I20260807 07:58:38.734134 30487 rpcz_store.cc:276] 0807 07:58:36.272335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:36.272469 (+ 134us) service_pool.cc:224] Handling call
0807 07:58:36.272810 (+ 341us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:58:36.273146 (+ 336us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:36.273173 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:58:36.274818 (+ 1645us) log.cc:844] Serialized 26 byte log entry
0807 07:58:36.455930 (+181112us) raft_consensus.cc:1645] Marking committed up to 9
0807 07:58:36.455967 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:36.456033 (+ 66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:58:38.729418 (+2273385us) raft_consensus.cc:1685] finished
0807 07:58:38.729490 (+ 72us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:38.729979 (+ 489us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22547,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":165,"thread_start_us":180604,"threads_started":1,"wal-append.queue_time_us":528843,"wal-append.run_cpu_time_us":1956,"wal-append.run_wall_time_us":1005589}
W20260807 07:58:38.738575 30320 connection.cc:256] RPC call timeout handler was delayed by -1.731135725043714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260807 07:58:38.739292 30320 connection.cc:256] RPC call timeout handler was delayed by -1.2331287739798427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260807 07:58:38.739652 30320 connection.cc:256] RPC call timeout handler was delayed by -1.2007287740707397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260807 07:58:38.740001 30320 connection.cc:256] RPC call timeout handler was delayed by -1.0317567500751466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260807 07:58:38.747398 3605 raft_consensus.cc:493] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:38.748574 3605 raft_consensus.cc:515] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:38.753479 3605 leader_election.cc:290] T 7bb6a0a753b94f2c8b30e9ae87311e53 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:38.795243 3244 raft_consensus.cc:3055] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:38.795718 3244 raft_consensus.cc:740] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:38.797108 3244 consensus_queue.cc:260] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:38.821452 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:38.822623 31383 raft_consensus.cc:3060] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Advancing to term 10
I20260807 07:58:38.829773 31379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eeea67c5e49472292549e65f2c9e844" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:38.831880 31379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d207f188764d0caf032e77702cdc6b" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:38.834038 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa37679a25174c858a325e86cb2d5c94" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:38.835175 31383 raft_consensus.cc:2468] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 10.
I20260807 07:58:38.836254 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:38.833319 31379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0f6bb896213415485f2dee06ba250b8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:38.837288 31379 raft_consensus.cc:3060] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Advancing to term 11
I20260807 07:58:38.851094 31379 raft_consensus.cc:2468] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 11.
I20260807 07:58:38.857887 30358 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45046 (request call id 2886) took 3955 ms. Trace:
I20260807 07:58:38.858897 30358 rpcz_store.cc:276] 0807 07:58:34.902411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:34.904693 (+ 2282us) service_pool.cc:224] Handling call
0807 07:58:34.904992 (+ 299us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:35.567533 (+662541us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:38.857188 (+3289655us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b54002fdad4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:58:38.857572 (+ 384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392968448}
I20260807 07:58:38.864547 3184 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:38.865401 3184 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:38.867940 3184 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:38.864614 3588 raft_consensus.cc:3060] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
W20260807 07:58:38.876503 3659 log.cc:927] Time spent T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19: Append to log took a long time: real 3.220s user 0.016s sys 0.014s
I20260807 07:58:38.880093 3591 raft_consensus.cc:493] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:38.880424 3600 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:38.880779 3591 raft_consensus.cc:515] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:38.881301 3600 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:38.883752 3600 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:38.883865 3627 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 election: Requested vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:38.885020 30542 leader_election.cc:304] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f831a53ec51d452398015797d543164e; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, b1188d7d3a0b455894bc443d571f6a19
I20260807 07:58:38.887001 3655 raft_consensus.cc:2749] T 0eeea67c5e49472292549e65f2c9e844 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260807 07:58:38.890681 30542 leader_election.cc:304] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:38.891841 3655 raft_consensus.cc:2804] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 11 FOLLOWER]: Leader election won for term 11
I20260807 07:58:38.892432 3655 raft_consensus.cc:697] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [term 11 LEADER]: Becoming Leader. State: Replica: f831a53ec51d452398015797d543164e, State: Running, Role: LEADER
I20260807 07:58:38.893951 3655 consensus_queue.cc:237] T d0f6bb896213415485f2dee06ba250b8 P f831a53ec51d452398015797d543164e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:38.960551 3543 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:38.961464 3543 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:38.965034 3543 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:38.966391 3533 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:38.967200 3533 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:38.974457 3605 raft_consensus.cc:493] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:38.975248 3605 raft_consensus.cc:515] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:38.977710 3544 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:38.978534 3544 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:38.980623 3544 leader_election.cc:290] T bca8ce0c4383454c82aca8ba08488278 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:38.977301 3605 leader_election.cc:290] T 69fb90f4806e416fb031249c3df91aa8 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:38.981118 3544 raft_consensus.cc:493] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:38.982663 3544 raft_consensus.cc:515] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:38.985888 3605 raft_consensus.cc:493] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:38.986519 3605 raft_consensus.cc:515] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:38.988731 3605 leader_election.cc:290] T 37222025709f4384a02a9c633ee3190c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:38.989885 3561 raft_consensus.cc:493] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:38.990729 3561 raft_consensus.cc:515] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:38.992506 3605 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:39.236330 3605 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:38.998431 3729 raft_consensus.cc:493] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:39.237920 3729 raft_consensus.cc:515] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:39.240341 3729 leader_election.cc:290] T 488daa184a3f4a30a48872c9fc1612dd P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:39.004567 30584 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42218 (request call id 823) took 3519 ms. Trace:
I20260807 07:58:39.241139 30584 rpcz_store.cc:276] 0807 07:58:35.485502 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:35.494349 (+ 8847us) service_pool.cc:224] Handling call
0807 07:58:35.494646 (+ 297us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:36.172135 (+677489us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:39.004022 (+2831887us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b5400189a54. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:58:39.004337 (+ 315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1510830336}
I20260807 07:58:39.008168 3730 raft_consensus.cc:493] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:39.242633 3730 raft_consensus.cc:515] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:39.244844 3730 leader_election.cc:290] T 78ad63a77c6546d6bc5db4234526fc78 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
W20260807 07:58:39.009472 30320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 119997us
I20260807 07:58:39.010198 3731 raft_consensus.cc:493] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:39.245820 3731 raft_consensus.cc:515] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:39.248160 3731 leader_election.cc:290] T 8c079d52d21e409b82acfebf494a8700 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:39.012229 30360 consensus_queue.cc:237] T 6e83da4401b5430295d02124cfe24f58 P b1188d7d3a0b455894bc443d571f6a19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } attrs { replace: true } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: NON_VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: true } }
I20260807 07:58:39.249940 3600 raft_consensus.cc:493] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:39.250624 3600 raft_consensus.cc:515] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:39.013652 30317 connection.cc:256] RPC call timeout handler was delayed by -1.768356024986133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260807 07:58:39.252646 30317 connection.cc:256] RPC call timeout handler was delayed by -1.529752359027043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
I20260807 07:58:39.257251 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15fa23df425445ce99709045bc6e9789" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.258579 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.259753 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.260885 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.024565 3688 raft_consensus.cc:493] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:39.262259 3688 raft_consensus.cc:515] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.264333 3688 leader_election.cc:290] T af8f2d95eba240e2965db9be8b951bee P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:39.265758 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:39.266671 30587 raft_consensus.cc:2393] T 69fb90f4806e416fb031249c3df91aa8 P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 6: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:39.267123 31379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.267751 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:39.268380 31378 raft_consensus.cc:1240] T d0f6bb896213415485f2dee06ba250b8 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 11 FOLLOWER]: Rejecting Update request from peer b1188d7d3a0b455894bc443d571f6a19 for earlier term 10. Current term is 11. Ops: []
I20260807 07:58:39.268565 30587 raft_consensus.cc:2393] T dbbfdde9e309488aa336d6982fa31c49 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 5: Already voted for candidate f831a53ec51d452398015797d543164e in this term.
I20260807 07:58:39.032083 30585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
W20260807 07:58:39.272308 31338 connection.cc:256] RPC call timeout handler was delayed by -1.5985117349773645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260807 07:58:39.272706 31338 connection.cc:256] RPC call timeout handler was delayed by -1.204927233280614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
I20260807 07:58:39.272650 30588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bca8ce0c4383454c82aca8ba08488278" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:39.033610 30590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e"
I20260807 07:58:39.273859 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30057a01f5fa4baba4b3b02fe84a0f78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:39.274259 30590 raft_consensus.cc:3060] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Advancing to term 5
I20260807 07:58:39.274996 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.035921 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:39.277746 30586 raft_consensus.cc:2468] T 7bb6a0a753b94f2c8b30e9ae87311e53 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:39.278858 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:39.279506 30586 raft_consensus.cc:2468] T 78ad63a77c6546d6bc5db4234526fc78 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:39.037225 31385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "457aab41fd17414ab083fedaf23f3ff8" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.282047 31376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.046901 3724 raft_consensus.cc:493] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:39.283226 3724 raft_consensus.cc:515] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.047585 3720 raft_consensus.cc:493] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:39.285072 30208 maintenance_manager.cc:419] P bea3ffe07a564dec8cb26697142f88e4: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033361
I20260807 07:58:39.050906 3715 raft_consensus.cc:493] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:39.060238 3591 leader_election.cc:290] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:39.062383 3736 raft_consensus.cc:493] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:39.071302 30364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33338 (request call id 734) took 3628 ms. Trace:
I20260807 07:58:39.252663 3600 leader_election.cc:290] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:39.280802 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61ca595a07a748bb83b4aa11cb066270" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:39.289436 30364 rpcz_store.cc:276] 0807 07:58:35.442898 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:35.443112 (+ 214us) service_pool.cc:224] Handling call
0807 07:58:35.443402 (+ 290us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:58:35.443744 (+ 342us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:35.443768 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:58:35.450911 (+ 7143us) log.cc:844] Serialized 26 byte log entry
0807 07:58:35.566755 (+115844us) raft_consensus.cc:1645] Marking committed up to 10
0807 07:58:35.566795 (+ 40us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:35.566866 (+ 71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:58:38.875421 (+3308555us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b440002250c. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b2078981 00007fd6b2116855 00007fd6b2117272 00007fd6b4ea13bb 00007fd6b4e9cc9f 00007fd6b4e90a5e 00007fd6b4e8fda6 00007fd6b4e8f9c8 00007fd6b4e99411 00007fd6b4e993c9 00007fd6b4e99359
0807 07:58:39.070692 (+195271us) raft_consensus.cc:1685] finished
0807 07:58:39.070716 (+ 24us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:39.071077 (+ 361us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3247,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":2448,"spinlock_wait_cycles":25578752,"thread_start_us":80630,"threads_started":1,"wal-append.queue_time_us":166241}
I20260807 07:58:39.078516 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9136a853c15441a6a0460d9da5efd3e9" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.074342 3738 raft_consensus.cc:493] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:58:39.085248 30623 debug-util.cc:398] Leaking SignalData structure 0x7b080034bd00 after lost signal to thread 30521
I20260807 07:58:39.091648 3615 raft_consensus.cc:493] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:39.291682 3738 raft_consensus.cc:515] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.292140 3615 raft_consensus.cc:515] T 14880a591ef44360b5046f67cab3d4ad P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.092789 3139 raft_consensus.cc:493] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b1188d7d3a0b455894bc443d571f6a19)
I20260807 07:58:39.098469 3533 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:39.099594 3588 raft_consensus.cc:493] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 07:58:39.101600 3180 raft_consensus.cc:493] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:39.294113 30582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d590969fc25f460ba23a897afd565f56" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:39.106191 3560 raft_consensus.cc:3055] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Stepping down as leader of term 7
I20260807 07:58:39.297456 3588 raft_consensus.cc:515] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.132026 30369 raft_consensus.cc:1275] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Refusing update from remote peer 6bd20e9c0d3e4ace86fc1f55ab9425fa: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260807 07:58:39.298012 3560 raft_consensus.cc:740] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b1188d7d3a0b455894bc443d571f6a19, State: Running, Role: LEADER
I20260807 07:58:39.298276 30369 pending_rounds.cc:85] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19: Aborting all ops after (but not including) 7
I20260807 07:58:39.298646 30369 pending_rounds.cc:107] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260807 07:58:39.298950 30369 raft_consensus.cc:2889] T 61ca595a07a748bb83b4aa11cb066270 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260807 07:58:39.134519 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ec7850a44f4310aa712fd0c381c65c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.299459 3560 consensus_queue.cc:260] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:39.300055 30490 raft_consensus.cc:2468] T 02ec7850a44f4310aa712fd0c381c65c P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:39.285251 3720 raft_consensus.cc:515] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:39.301004 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfdde9e309488aa336d6982fa31c49" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:39.301458 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fb90f4806e416fb031249c3df91aa8" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.300163 30479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34358 (request call id 631) took 4542 ms. Trace:
I20260807 07:58:39.294866 3180 raft_consensus.cc:515] T 0032603adf8446cd9a59f26cc868400c P f831a53ec51d452398015797d543164e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.142377 31382 raft_consensus.cc:1240] T 9136a853c15441a6a0460d9da5efd3e9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 12 LEADER]: Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260807 07:58:39.302286 30479 rpcz_store.cc:276] 0807 07:58:34.758106 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:35.238494 (+480388us) service_pool.cc:224] Handling call
0807 07:58:35.372626 (+134132us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:35.372813 (+ 187us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:35.372836 (+ 23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:35.372877 (+ 41us) raft_consensus.cc:1645] Marking committed up to 8
0807 07:58:35.372913 (+ 36us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:35.372964 (+ 51us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:39.299793 (+3926829us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540012c850. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f5c8d 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6 00007fd6b362ee5f
0807 07:58:39.299984 (+ 191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307807616}
I20260807 07:58:39.159417 3561 leader_election.cc:290] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:39.162010 3244 raft_consensus.cc:3060] T 32d8c79eca1d4172b7e3662b5e509782 P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:39.303772 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917731a02aaa4ad1bda800eb0961e3ce" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:39.305892 3588 leader_election.cc:290] T dfc043461f2840a385956057685df8f9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:39.162458 30427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:39.306700 3560 raft_consensus.cc:3060] T ed9fcd0597fe4e24a7e11fe5c535623c P b1188d7d3a0b455894bc443d571f6a19 [term 7 FOLLOWER]: Advancing to term 8
I20260807 07:58:39.193892 3610 raft_consensus.cc:493] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:39.195806 30581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42218 (request call id 829) took 3030 ms. Trace:
I20260807 07:58:39.197100 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.198755 30477 raft_consensus.cc:1275] T 0e7ae50210ec4ccbb091fa0962200c3e P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260807 07:58:39.201148 30480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34358 (request call id 627) took 4760 ms. Trace:
I20260807 07:58:39.201850 30578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34604 (request call id 2416) took 2746 ms. Trace:
I20260807 07:58:39.196975 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:39.206406 3544 leader_election.cc:290] T dbbfdde9e309488aa336d6982fa31c49 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:39.209403 31336 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.930s user 0.054s sys 0.078s
I20260807 07:58:39.210861 3543 raft_consensus.cc:493] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
W20260807 07:58:39.214607 30429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.716s user 0.055s sys 0.072s
I20260807 07:58:39.221094 30476 raft_consensus.cc:1275] T f6c4147ecb7e4996ac3b4ff12effa194 P ef1ca7acf52a438f89f14707e9e06818 [term 12 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260807 07:58:39.303836 30585 raft_consensus.cc:3060] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 6 FOLLOWER]: Advancing to term 7
I20260807 07:58:39.313328 30372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45046 (request call id 2884) took 4849 ms. Trace:
I20260807 07:58:39.233629 3627 raft_consensus.cc:493] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:39.312634 3561 raft_consensus.cc:493] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:39.311066 31372 raft_consensus.cc:2376] T 5df190e0d6d146e8a2f82d090c06ecdf P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f831a53ec51d452398015797d543164e in term 10. Re-sending same reply.
I20260807 07:58:39.311404 30487 raft_consensus.cc:2468] T fe6785f099494896ae258fd098deadc1 P ef1ca7acf52a438f89f14707e9e06818 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 11.
I20260807 07:58:39.232159 3582 raft_consensus.cc:493] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f831a53ec51d452398015797d543164e)
I20260807 07:58:39.293710 3736 raft_consensus.cc:515] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.108521 3662 raft_consensus.cc:493] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260807 07:58:39.295114 30623 debug-util.cc:398] Leaking SignalData structure 0x7b080037aea0 after lost signal to thread 30523
W20260807 07:58:39.327622 31336 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.048s user 0.054s sys 0.080s
I20260807 07:58:39.294269 3139 raft_consensus.cc:515] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.312146 30477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d8c79eca1d4172b7e3662b5e509782" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.295814 30587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6785f099494896ae258fd098deadc1" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:39.308097 3610 raft_consensus.cc:515] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.290650 30488 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33928 (request call id 2884) took 3594 ms. Trace:
I20260807 07:58:39.310995 3637 raft_consensus.cc:493] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6bd20e9c0d3e4ace86fc1f55ab9425fa)
I20260807 07:58:39.313798 30372 rpcz_store.cc:276] 0807 07:58:34.463692 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:34.463816 (+ 124us) service_pool.cc:224] Handling call
0807 07:58:34.464075 (+ 259us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:35.322160 (+858085us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:39.312865 (+3990705us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b5400341cd4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:58:39.313127 (+ 262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938517376}
I20260807 07:58:39.324396 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75bed1078db6464388c6bf0bea4a4be6" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.267771 31379 raft_consensus.cc:2468] T e6f61d2b65b04216b54f6a2f8deadd0a P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:58:39.317013 30586 raft_consensus.cc:2410] T 61ca595a07a748bb83b4aa11cb066270 P f831a53ec51d452398015797d543164e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260807 07:58:39.316184 30487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8918375a62fa49ce8a2a4e5ef0f403df" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.311879 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a3620947f6449ab35a25835dd90fda" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:39.312497 30480 rpcz_store.cc:276] 0807 07:58:34.440194 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:35.200355 (+760161us) service_pool.cc:224] Handling call
0807 07:58:35.200634 (+ 279us) raft_consensus.cc:1471] Updating replica for 0 ops
0807 07:58:35.210678 (+ 10044us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:35.210709 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0807 07:58:35.210753 (+ 44us) raft_consensus.cc:1645] Marking committed up to 11
0807 07:58:35.210785 (+ 32us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:39.200625 (+3989840us) spinlock_profiling.cc:243] Waited 9.84 ms on lock 0x7b540025b054. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:58:39.200689 (+ 64us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:39.200927 (+ 238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22622976}
I20260807 07:58:39.340631 3610 leader_election.cc:290] T 24224c3e18ec49578bb6c7bd4fd217b5 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:39.329404 30488 rpcz_store.cc:276] 0807 07:58:35.696049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:35.696144 (+ 95us) service_pool.cc:224] Handling call
0807 07:58:35.696417 (+ 273us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:58:35.744428 (+ 48011us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:35.744455 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:58:35.764057 (+ 19602us) log.cc:844] Serialized 26 byte log entry
0807 07:58:36.497630 (+733573us) raft_consensus.cc:1645] Marking committed up to 4
0807 07:58:36.497668 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:36.497740 (+ 72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:58:39.290201 (+2792461us) raft_consensus.cc:1685] finished
0807 07:58:39.290237 (+ 36us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:39.290456 (+ 219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48263,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":31009,"thread_start_us":747946,"threads_started":2,"wal-append.queue_time_us":992762,"wal-append.run_cpu_time_us":2395,"wal-append.run_wall_time_us":1002440}
I20260807 07:58:39.309820 3544 raft_consensus.cc:493] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef1ca7acf52a438f89f14707e9e06818)
I20260807 07:58:39.343091 3544 raft_consensus.cc:515] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
W20260807 07:58:39.344081 3685 consensus_queue.cc:1175] T 26a3620947f6449ab35a25835dd90fda P ef1ca7acf52a438f89f14707e9e06818 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f831a53ec51d452398015797d543164e" responder_term: 10 status { last_received { term: 9 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ef1ca7acf52a438f89f14707e9e06818 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260807 07:58:39.343254 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61d2b65b04216b54f6a2f8deadd0a" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.345916 30579 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34604 (request call id 2402) took 3877 ms. Trace:
I20260807 07:58:39.346612 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78ad63a77c6546d6bc5db4234526fc78" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.347158 3139 leader_election.cc:290] T f2c57e3fb98348029b5e341d17d669bd P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:39.347906 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.348341 30542 leader_election.cc:304] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:39.344990 30590 raft_consensus.cc:2468] T 5c9372d30eda4764a440dbb9f0bc8129 P f831a53ec51d452398015797d543164e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 5.
W20260807 07:58:39.350410 30623 debug-util.cc:398] Leaking SignalData structure 0x7b0800167240 after lost signal to thread 30627
I20260807 07:58:39.349117 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37222025709f4384a02a9c633ee3190c" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:58:39.352018 30623 debug-util.cc:398] Leaking SignalData structure 0x7b0800396ee0 after lost signal to thread 31418
I20260807 07:58:39.312520 30581 rpcz_store.cc:276] 0807 07:58:36.165298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:36.165486 (+ 188us) service_pool.cc:224] Handling call
0807 07:58:36.169596 (+ 4110us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:58:36.169974 (+ 378us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:36.170011 (+ 37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:58:36.170507 (+ 496us) log.cc:844] Serialized 26 byte log entry
0807 07:58:36.442300 (+271793us) raft_consensus.cc:1645] Marking committed up to 7
0807 07:58:36.442342 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:36.442410 (+ 68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:58:39.195323 (+2752913us) raft_consensus.cc:1685] finished
0807 07:58:39.195360 (+ 37us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:39.195594 (+ 234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":795,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":6289,"thread_start_us":249290,"threads_started":1,"wal-append.queue_time_us":547584,"wal-append.run_cpu_time_us":2086,"wal-append.run_wall_time_us":1062879}
I20260807 07:58:39.309407 30578 rpcz_store.cc:276] 0807 07:58:36.454793 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:36.455094 (+ 301us) service_pool.cc:224] Handling call
0807 07:58:36.455373 (+ 279us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:58:36.459196 (+ 3823us) raft_consensus.cc:1534] Early marking committed up to index 0
0807 07:58:36.459227 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0807 07:58:36.466971 (+ 7744us) log.cc:844] Serialized 26 byte log entry
0807 07:58:39.187961 (+2720990us) raft_consensus.cc:1645] Marking committed up to 4
0807 07:58:39.188021 (+ 60us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:39.188124 (+ 103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0807 07:58:39.201448 (+ 13324us) raft_consensus.cc:1685] finished
0807 07:58:39.201466 (+ 18us) raft_consensus.cc:1691] UpdateReplicas() finished
0807 07:58:39.201657 (+ 191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3403,"raft.queue_time_us":3526,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":9800,"thread_start_us":106079,"threads_started":1,"wal-append.queue_time_us":2693651}
I20260807 07:58:39.352154 30488 raft_consensus.cc:2468] T 37222025709f4384a02a9c633ee3190c P ef1ca7acf52a438f89f14707e9e06818 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 10.
I20260807 07:58:39.353886 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb6a0a753b94f2c8b30e9ae87311e53" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.314262 3627 raft_consensus.cc:515] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.355564 30488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.310565 3543 raft_consensus.cc:515] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.356411 30488 raft_consensus.cc:2468] T 3c1d04e8312f4ddcb5bcfc4160d4e615 P ef1ca7acf52a438f89f14707e9e06818 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 4.
I20260807 07:58:39.358414 3543 leader_election.cc:290] T 5cb72552d8da48b78c58110bb0c84f61 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
W20260807 07:58:39.359112 30429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.861s user 0.056s sys 0.072s
I20260807 07:58:39.360670 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9372d30eda4764a440dbb9f0bc8129" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818"
I20260807 07:58:39.352893 30581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488daa184a3f4a30a48872c9fc1612dd" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:39.314890 3561 raft_consensus.cc:515] T 1f5785da4aac4398afc22beefd2bd76b P b1188d7d3a0b455894bc443d571f6a19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.359949 30588 raft_consensus.cc:2468] T bca8ce0c4383454c82aca8ba08488278 P f831a53ec51d452398015797d543164e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 3.
I20260807 07:58:39.346315 30579 rpcz_store.cc:276] 0807 07:58:35.468132 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:35.468264 (+ 132us) service_pool.cc:224] Handling call
0807 07:58:35.468528 (+ 264us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:58:35.947366 (+478838us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:39.345293 (+3397927us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54003fd9d4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:58:39.345715 (+ 422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095481088}
I20260807 07:58:39.287511 3715 raft_consensus.cc:515] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
W20260807 07:58:39.371536 30429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.131:33207, user_credentials={real_user=slave}} blocked reactor thread for 2.89871e+06us
I20260807 07:58:39.374958 30480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.366293 3544 leader_election.cc:290] T 5b78e546552f4ce38217f522549d6f36 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:39.376847 30490 raft_consensus.cc:2468] T 75bed1078db6464388c6bf0bea4a4be6 P ef1ca7acf52a438f89f14707e9e06818 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 9.
I20260807 07:58:39.388635 30584 raft_consensus.cc:1275] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [term 9 FOLLOWER]: Refusing update from remote peer b1188d7d3a0b455894bc443d571f6a19: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260807 07:58:39.387283 30480 raft_consensus.cc:2468] T dfc043461f2840a385956057685df8f9 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 6.
I20260807 07:58:39.389499 30586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c1d04e8312f4ddcb5bcfc4160d4e615" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f831a53ec51d452398015797d543164e" is_pre_election: true
I20260807 07:58:39.388048 30581 raft_consensus.cc:2468] T 488daa184a3f4a30a48872c9fc1612dd P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:39.392370 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c079d52d21e409b82acfebf494a8700" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.386837 30317 leader_election.cc:304] T 02ec7850a44f4310aa712fd0c381c65c P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b1188d7d3a0b455894bc443d571f6a19, ef1ca7acf52a438f89f14707e9e06818; no voters:
I20260807 07:58:39.393910 3605 leader_election.cc:290] T d30d61dc67614c5c9d0f1083e2a463b9 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:39.407023 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.407593 30429 leader_election.cc:304] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef1ca7acf52a438f89f14707e9e06818; no voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e
I20260807 07:58:39.408041 30490 raft_consensus.cc:2468] T af8f2d95eba240e2965db9be8b951bee P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:39.408594 3139 raft_consensus.cc:2749] T a6acbd1341f44b138a96457c583930e4 P ef1ca7acf52a438f89f14707e9e06818 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260807 07:58:39.401822 3724 leader_election.cc:290] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:39.409183 30490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
I20260807 07:58:39.411425 31382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59392 (request call id 617) took 3218 ms. Trace:
I20260807 07:58:39.397123 3738 leader_election.cc:290] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:39.412273 31382 rpcz_store.cc:276] 0807 07:58:36.187584 (+ 0us) service_pool.cc:167] Inserting onto call queue
0807 07:58:36.187783 (+ 199us) service_pool.cc:224] Handling call
0807 07:58:36.188079 (+ 296us) raft_consensus.cc:1471] Updating replica for 1 ops
0807 07:58:39.303158 (+3115079us) raft_consensus.cc:1697] Filling consensus response to leader.
0807 07:58:39.401862 (+ 98704us) spinlock_profiling.cc:243] Waited 2.95 s on lock 0x7b540039d0d4. stack: 00007fd6b21bdcf3 00007fd6b21bdbf0 00007fd6b1b48574 00007fd6bb8de6c4 00007fd6bb8de659 00007fd6b525f951 00007fd6b52f71e1 00007fd6b52f5c1e 00007fd6ba2ec229 00007fd6b3831d34 00007fd6b3831cc2 00007fd6b3831bf1 00007fd6b3831b6c 00007fd6b3830e22 00007fd6b363007c 00007fd6b362f4b6
0807 07:58:39.405581 (+ 3719us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6792964352}
I20260807 07:58:39.375656 3637 raft_consensus.cc:515] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.416558 3637 leader_election.cc:290] T 0eeea67c5e49472292549e65f2c9e844 P b1188d7d3a0b455894bc443d571f6a19 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f831a53ec51d452398015797d543164e (127.27.64.131:33207), 6bd20e9c0d3e4ace86fc1f55ab9425fa (127.27.64.132:36619)
I20260807 07:58:39.316147 3582 raft_consensus.cc:515] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } } peers { permanent_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" member_type: VOTER last_known_addr { host: "127.27.64.132" port: 36619 } attrs { promote: false } }
I20260807 07:58:39.422991 3582 leader_election.cc:290] T d590969fc25f460ba23a897afd565f56 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), f831a53ec51d452398015797d543164e (127.27.64.131:33207)
I20260807 07:58:39.369439 3662 raft_consensus.cc:515] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1188d7d3a0b455894bc443d571f6a19" member_type: VOTER last_known_addr { host: "127.27.64.129" port: 36407 } } peers { permanent_uuid: "ef1ca7acf52a438f89f14707e9e06818" member_type: VOTER last_known_addr { host: "127.27.64.130" port: 35917 } } peers { permanent_uuid: "f831a53ec51d452398015797d543164e" member_type: VOTER last_known_addr { host: "127.27.64.131" port: 33207 } }
I20260807 07:58:39.425951 31377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151ecad19f9e4079986c980524b2f3c0" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.425866 31384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
W20260807 07:58:39.428244 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.64.130:35917, user_credentials={real_user=slave}} blocked reactor thread for 53430.8us
I20260807 07:58:39.430186 30585 raft_consensus.cc:2468] T 917731a02aaa4ad1bda800eb0961e3ce P f831a53ec51d452398015797d543164e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 7.
I20260807 07:58:39.426640 31377 raft_consensus.cc:2468] T 151ecad19f9e4079986c980524b2f3c0 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:58:39.431265 30477 raft_consensus.cc:2393] T 32d8c79eca1d4172b7e3662b5e509782 P ef1ca7acf52a438f89f14707e9e06818 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b1188d7d3a0b455894bc443d571f6a19 in current term 8: Already voted for candidate ef1ca7acf52a438f89f14707e9e06818 in this term.
I20260807 07:58:39.431653 31378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f16f3d2817a34261bb25577fa0f9e2de" candidate_uuid: "f831a53ec51d452398015797d543164e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.432447 31378 raft_consensus.cc:2468] T f16f3d2817a34261bb25577fa0f9e2de P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f831a53ec51d452398015797d543164e in term 8.
I20260807 07:58:39.432929 31372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cb72552d8da48b78c58110bb0c84f61" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.433733 31372 raft_consensus.cc:2468] T 5cb72552d8da48b78c58110bb0c84f61 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:39.434907 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24224c3e18ec49578bb6c7bd4fd217b5" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.435439 31380 raft_consensus.cc:2468] T 24224c3e18ec49578bb6c7bd4fd217b5 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:39.431149 31383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30d61dc67614c5c9d0f1083e2a463b9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.436829 31383 raft_consensus.cc:2468] T d30d61dc67614c5c9d0f1083e2a463b9 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 9.
I20260807 07:58:39.408679 3745 raft_consensus.cc:2804] T 5df190e0d6d146e8a2f82d090c06ecdf P f831a53ec51d452398015797d543164e [term 10 FOLLOWER]: Leader election won for term 10
I20260807 07:58:39.425835 31379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc043461f2840a385956057685df8f9" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa" is_pre_election: true
I20260807 07:58:39.440732 30479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b78e546552f4ce38217f522549d6f36" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef1ca7acf52a438f89f14707e9e06818" is_pre_election: true
W20260807 07:58:39.441951 30320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260807 07:58:39.438879 30542 leader_election.cc:304] T 151ecad19f9e4079986c980524b2f3c0 P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:39.444875 30542 leader_election.cc:304] T f16f3d2817a34261bb25577fa0f9e2de P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6bd20e9c0d3e4ace86fc1f55ab9425fa, f831a53ec51d452398015797d543164e; no voters:
I20260807 07:58:39.445621 31380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df190e0d6d146e8a2f82d090c06ecdf" candidate_uuid: "ef1ca7acf52a438f89f14707e9e06818" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"
I20260807 07:58:39.407083 3715 leader_election.cc:290] T 0e7ae50210ec4ccbb091fa0962200c3e P f831a53ec51d452398015797d543164e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b1188d7d3a0b455894bc443d571f6a19 (127.27.64.129:36407), ef1ca7acf52a438f89f14707e9e06818 (127.27.64.130:35917)
I20260807 07:58:39.441314 31384 raft_consensus.cc:2468] T 5b78e546552f4ce38217f522549d6f36 P 6bd20e9c0d3e4ace86fc1f55ab9425fa [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1188d7d3a0b455894bc443d571f6a19 in term 8.
I20260807 07:58:39.444031 31382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af8f2d95eba240e2965db9be8b951bee" candidate_uuid: "b1188d7d3a0b455894bc443d571f6a19" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6bd20e9c0d3e4ace86fc1f55ab9425fa"